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Executive Summary 


Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, is a federally- 
funded system of grants that focuses on preparing low-income students to enter and succeed in 
postsecondary educational programs. GEAR UP grants extend across 6 school years and require that 
funded districts begin providing grant serv ices to students no later than the seventh grade and continue 
services until students graduate from high school. GEAR UP also requires that districts implement a 
cohort model in which services are provided to all students in participating grade levels rather than to 
select groups of students. 

Ihc United States Department of Education (USDE) provides for two types of GEAR UP grants: ( 1 ) 
partnerships grants made up of school districts, colleges or universities, and other organizations, and (2) 
state grants administered by state agencies, either alone or in partnership with other entities. Since 2006, 
the Texas Education Agency (TEA) has implemented a state-level GEAR UP grant, known as Students 
Training for Academic Readiness, or STAR. STAR is implemented in six school districts in south Texas 
that serve large proportions of low-income and minority students. These districts include Alice ISD, 
Brooks County ISD. Corpus Christi ISD. Kingsville ISD. Mathis ISD. and Odem-Edroy ISD. In each 
district, a high school and its associated feeder pattern middle school participates in STAR. 

The 6-year implementation period for STAR spans the 2006-07 through 2011-12 school years, and began 
with an initial seventh-grade cohort in 2006-07. As this cohort has progressed through school. STAR’S 
services have expanded to include additional grade levels. In 2010 - 1 1 , the grant’s fifth implementation 
year, the lead seventh-grade cohort was in the eleventh grade and STAR services were provided to all 
students in Grades 7 through 1 1 . 

In addressing GEAR UP’s goal of improving students’ participation in postsecondary educational 
opportunities. ST AR addresses four core components of improving college readiness: 

1 . Increase information provided to students and their families regarding postsec ondary activities 
(Information Access and Early Intervention); 

2. Increase student access to advanced academic programs (Advanced Academics); 

3. Increase training for teachers and counselors regarding the assessment of student abilities and the 
means for assisting students in postsecondary choices (Educator Preparation): and 

4. Increase parent involvement and community and family support in a student’s decision to go to 
college (Family and Community Participation and Support). 

In conjunction with these puiposcs. STAR identifies eight specific goals for participating districts: 

1 . Increase the number of underrepresented (low-income and minority students) who arc prepared to 
go to college. 

2. Increase the number of limited English proficient (LEP) Hispanic students who successfully 
graduate and go to college. 

3. Strengthen academic programs and student services at participating schools. 

4. Build an academic pipeline from school to college. 

5. Develop effective and enduring alliances among schools, colleges, students, parents, government, 
and community groups 

6. Improve teaching and learning. 

7. Provide students with intensive, individualized support. 

8. Raise standards of academic achievement for all students. 




Each goal contains a set of specific objectives that outline clear criteria for the achievement of each goal 
across project years. The complete set of STAR goals and their associated objectives arc included in 
Appendix F of this report. STAR addresses its goals through a collaborative partnership that includes 
TEA, the College Board, the Pre-College Outreach Center (POC) at the College of Education at Texas 
A&M University-Corpus Christi, and Fathers Active in Communities and Education (FACE). 

THE EVALUATION OF STAR 

GEAR UP grant requirements also include an evaluation component designed to assess effectiveness and 
measure progress toward project goals. The findings presented in this report make up the fifth year 
evaluation of the state's GEAR IJP/STAR project The evaluation is limited to the GEAR UP state grant 
(i.c., STAR) and does not include GEAR UP partnership grants awarded to other entities in Texas. 1 

The purpose of the evaluation is to understand how districts implement STAR and the effectiveness of 
their implementation strategics in preparing students for postsecondary education. To this end. the 
evaluation is guided by the following research questions: 

1. What are the characteristics of participating STAR schools, students, teachers, and parents? 

2. How is STAR implemented across participating campuses? 

3. What are the ef fects of STAR implementation on indicators of student achievement and college 
preparation? 

The evaluation employs a mixed-methods research design that combines qualitative and quantitative 
approaches to analyses. Data sources include interviews with district and campus-level administrators, 
core subject area teachers, counselors, and STAR coordinators; surveys of students, parents, teachers, 
librarians, and counselors; observations in STAR classrooms; and demographic and performance data 
collected through the Texas Public Education Information Management System (PEIMS) and the Texas 
Academic Excellence Indicator System (AEiS). 

The STAR evaluation will produce six reports — one for each year the grant is implemented.* While this 
report focuses on STAR'S fifth implementation year (i.c.. 2010-1 1). it includes comparisons to previous 
grant years as a means to illustrate changes over time. 

MAJOR FINDINGS 

Characteristics of Students Participating in STAR and Performance Indicators for STAR 
Schools in 2010-11 

In 2010-11. a majority of students participating in STAR <i.e., tirades 7 through Ilf were Hispanic 
<89% ) and from low -income backgrounds <75% h In spite of the large proportion of Hispanic students, 
only 2% of students receiving STAR services were characterized as LEP. and only 2 % received bilingual 
or English as a second language (ESL) services. 


'In 2010-11. 19 GEAR UP partnership grants, or "Statewide Initiatives,** operated in Texas. 
Annual STAR evaluation reports may be accessed at. Intp . Acer.org’ research star/index.aspx 
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Across STAR campuses, the trends in the TAKS passing rates 3 for students receiving grant services 
reflected the trends of peer campuses 4 and the state as a whole. Students in STAR'S first cohort (i.c., 
students in Grade II in 2010-1 1 ) saw increases in their math and reading' EL A passing rates as well as in 
“all tests taken/* However, students in the remaining STAR cohorts (i.c., students in Grades 7 through 10) 
experienced cither no changes or declines in their TAKS passing rates in 2010-1 1 . 

State-assigned accountability ratings for STAR campuses reflect the lack of growth in TAKS 
passing rates. In 2010-1 1, half of STAR campuses (four high schools and two middle schools) were 
rated Academically Unacceptable. The remaining schools (two high schools and four middle schools) 
were rated Acceptable. 

STAR Implementation 

The evaluation measures the extent to which STAR schools implement activities and services aligned 
with the project's four core components. To this end. the evaluation considers STAR campuses* 
effectiveness in: ( 1) Raising Academic Standards. (2) Engaging Teachers and Students, (3) Increasing 
Student and Parent Access to Information, and (4) Building School and Community Cultures that Support 
Academic Achievement. The sections that follow discuss key findings for each of these aspects of STAR 
implementation. 

Raising Academic Standards 

The measurement of Raising Academic Standards reflects the extent to which teachers increase 
instructional rigor {Academic Rigor ) and align curriculum (Curricular Alignment), and the extent to 
which STAR schools engage high school students in advanced coursework (Advanced Academics). On 
average. STAR schools partially implemented instructional and curricular reforms designed to raise 
academic standards during the 2010-1 1 school year, although trends over time indicate increases in 
students* engagement in classroom instruction, as well as in the proportions of high school students 
completing advanced coursework and participating in AP testing. 

In Year 5, STAR campuses implemented instructional and curricular strategies focused on 
increasing Academic Rigor inconsistently. Relative to the 2009-10 grant year, data collected in 2010-1 1 
reflect: 

• Decreases in teachers* use of questioning strategies requiring higher order thinking at both the 
middle school and high school levels; 

• Decreases in teachers* use of subject-specific instructional strategics in all core content areas at 
the high school level and in science and math at the middle school level; 

• Increases in teachers* use of subject-specific instructional strategics in ELA and social studies at 
the middle school level; and 


^Changes in TAKS passing lates are measured from students* baseline year (Grade 6 TAKS) to the current school 
yea r (2010-1 1 ). Because STAR serves a range of giade levels the baseline year for each cohort of students will vary. 
For example, the baseline year for the first cohort of students (sev enth gradeis in 2006-07) is 2005-06. while the 
haseliiw year for the second cohort of students to receive STAR services (seventh gradeis in 2007-08) is 2006-07. 
4 For each campus in the state. TEA has created a peer or comparison group of 40 public school campuses selected 
on the basis of six student demographic characteristics, including the percentages of African American. Hispanic, 
and White students, the percentage of economically disadvantaged students, the percentage of limited English 
proficient students, and the campus mobility rate (2007 Accountability Manual. TEA). For a specific performance 
indicator. TEA reports the median value of the 40 comparison campuses on that indicator. Thus, peer groups allow 
for comparisons of campus performance for similar schools. 
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• Increases in student engagement in classroom activities at both the middle school and high school 
levels. 

Notably, middle school students have shown progressively higher levels of engagement across STAR's 
implementation years. Results at the high school level have fluctuated across years, but reached their 
highest level in 201 1. 

As in previous evaluation years, teachers reported that time and scheduling constraints continued 
to limit Curricular Alignment efforts on STAR campuses. On average, surveyed teachers said they met 
in vertical teams to plan aligned instruction only once or twice a semester. In addition, some teachers said 
that the use of vertically aligned curricula, such as CSCOPE. reduced the need for teachers work in 
vertical teams. Despite the challenges of meeting in vertical teams, many teachers highlighted the value of 
time spent collaborating with colleagues to plan instruction, noting that shared planning time facilitated 
the development of lessons that better prepared students for subsequent grade levels and college 
course work. 

STAR high schools have consistently improved students' participation in Advanced Academics 
across implementation years, although some data indicate that the rigor of instruction in advanced 
courses is not yet sufficient to prepare students for college course work. Year 5 data indicate that: 

• 20% of students in STAR high schools took advanced courses 5 (c.g.. AP or dual credit courses) 
relative to only 14% of students in the grant's first year (i.c.. 2006-07); 

• 19% of students in STAR high schools participated in AP testing relative to only 9% of students 
in the grant's first year: and 

• Only 5% of students in STAR high schools who participated in AP testing earned a score of 3 or 
better relative to 8% of students in the grant's first year. 6 

These findings suggest that STAR high schools have been successful in encouraging students to enroll in 
AP courses and participate in AP testing, but they have not provided students with the level of academic 
preparation needed to be awarded college credit for AP coursework. 

Engaging Teachers and Students 

The Engaging Teachers and Students component of STAR implementation measures the degree to which 
teachers and students are engaged in achieving program goals and considers ( 1 ) Teacher Engagement in 
Professional Development Activities and (2) Student Engagement in Schooling. Overall. STAR campuses 
substantially engaged teachers and students during the project's fifth year, although scores for this 
component declined in 2010-1 1 relative to previous evaluation years. 

Teachers have consistently reported high levels of engagement in professional development across 
all implementation years, although survey responses in 2010-11 reflected a small decrease at the 
high school level. In interviews, some teachers said that STAR was receiving less emphasis as it entered 
its final years, which may partly explain the decline in teachers* engagement. 


'Data representing student participation in advanced courses are lagged a year. That is. Year 5 indicators rely on 
data collected during the 2009- 1 0 school year, and Year 1 indicators rely on data collected during the 2005-06 
school year. 

’Although policies vary, most colleges award eollege credit for AP test scores of 3 or higher. 
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STAR campuses have had high levels of student engagement across evaluation years, but scores 
declined somewhat in 2010-11. particularly at the middle sch<H)l level. This finding is likely related to 
a reduced focus on STAR implementation as the grant enters its last years. Results for middle schools 
also suggest that STAR has received less attention since the lead STAR cohort (seventh graders in 
2006-07) moved to high school. 

Increasing Student and Parent Access to Information 

STAR provides increased access to information about postsccondary educational opportunities as a means 
to increase academic achievement and develop college-going cultures among low-income students and 
their families. STAR informational resources are focused on improving parents* and students* ability to 
plan and prepare for long-term educational goals. In measuring this component of STAR, the evaluation 
considers schools* effectiveness in providing information to ( I ) students {Student Access to Information) 
and (2) parents {Parent Access to Information ). 

Across years, STAR campuses have provided students with access to information that approached 
substantial levels; however, results for 2010-11 mark a decline from the levels observed in previous 
years, particularly at middle schools. Proportionately, fewer middle school students reported familiarity 
with postsccondary opportunities, such as 4-ycar colleges, community colleges, and vocational-technical 
schools. Middle school students* awareness of college entrance requirements and financial aid also 
declined. In contrast, these measures generally increased at the high school level. 

On average, parents have had partial access to information across STAR implementation years, and 
results for 2010-11 indicate that both high school and middle school parents had less access to 
information than in previous grant years. Less than a third of surveyed parents reported receiving 
information about college planning topics from their students* school in 2010-1 1, although most parents 
said they talked to their students about college planning and provided support for academic goals. 

Building School and Community Cultures That Support Academic Achievement 

STAR also seeks to support academic outcomes by building school and community cultures focused on 
student achievement. In measuring the degree to which school and community cultures provide support 
for student outcomes, the evaluation considers: ( 1 ) School Environment and (2) Parent and Community 
Support 

Across grant years, results for both middle schools and high schools have indicated that School 
Environments provide substantial levels of buy-in and support for STAR. Despite considerable 
administrative turnover in some districts, staff on STAR campuses have generally agreed that school 
leaders support grant goals, foster buy-in among staff, and encourage innovation in instruction. 

Evaluation findings for each STAR implementation year have indicated that Parent and Community 
Support has been substantial: however, results from recent evaluation years (i.e., 2009-10 and 2010- 
11) reflect declines in parent support relative to previous grant years. In interviews conducted in 
spring 201 1. school administrators highlighted the challenges of increasing parents* engagement in school 
activities and raising their expectations for students* academic outcomes, noting that some parents were 
resistant to schools* efforts to engage students in rigorous coursework. 



THE ONGOING EVALUATION 


The evaluation will continue to gather data across the project’s sixth implementation year (i.c., 201 1-12), 
including survey and site visit data and demographic and performance data collected by TLA. As the lead 
STAR cohort progresses through high school, the evaluation will focus on how districts’ implementation 
strategics change in order to meet the needs of students with immediate college planning needs and how 
districts’ efforts may affect students’ postsecondary outcomes. In addition, the evaluation will consider 
how districts plan to sustain the implementation of STAR'S reforms when grant funds expire in 2012. 



Chapter 1 
Introduction 


This report presents the Year 5 (2010-1 1 ) evaluation results for Texas' state Gaining Early Awareness 
and Readiness for Undergraduate Programs, or GEAR UP, grant, known as Students Training for 
Academic Readiness, or STAR. GEAR UP is a federally-funded system of grants that focuses on 
preparing low-income students to enter and succeed in postsecondary educational programs. The United 
States Department of Education (USDE) provides for two types of GEAR UP grants: { I ) partnership 
grants made up of school districts, colleges or universities, and other organizations, and (2) state grants 
administered by state education agencies, either alone or in partnership with other entities. 

Texas' state grant is administered by the Texas Education Agency (TEA) and will receive approximately 
SIS million in federal funding across the 2006-07 through 2011-12 school years. This funding supports 
the implementation of the GEAR UP/STAR college readiness initiative in six low-income school districts 
in Texas' Gulf Coast region, as well as TEA's statewide efforts to promote college readiness. The six 
distnets that participate in STAR arc: 

1. Alice Independent School District. Alice. Texas; 

2. Brooks County Independent School District. Falfurrias. Texas; 

3. Corpus Christi Independent School District, Corpus Christi. Texas; 

4. Kingsville Independent School District. Kingsville. Texas: 

5. Mathis Independent School District. Mathis. Texas; and 

6. Odem-Edroy Independent School District. Odern, Texas. 

These districts receive funding ranging from SI 34.000 to $209,000 for each year of STAR 
implementation and are required to match a minimum of 100% of federal funding with local revenue/ In 
each STAR district, a middle school and its associated feeder pattern high school participate in the grant. 

The USDE requires that GEAR UP districts implement a cohort model in which services are provided to 
all students in participating grade levels rather than to select groups of students. Districts must begin 
providing services to students no later than the seventh grade and services must continue until students 
complete the twelfth grade. STAR'S lead student cohort was in the seventh grade in 2006-07 and as this 
cohort has progressed through school, grant services have expanded to include additional grade levels. In 
2010-11. STAR's fifth year, the lead seventh-grade cohort was in the eleventh grade and services were 
provided to all students in Grades 7 through 1 1. Table 1.1 illustrates how the cohort model is 
implemented in STAR districts. 


^Nationally. about a thiid of GEAR IJP funds have been awarded in terms of state grants, and two thirds of funds 
have been awarded in the form of partnership grants (USDE, 2008). 

*In 2010-1 1. tlae matching rate for STAR districts was 102.8%. 
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Table 1.1. STAR Student Cohorts by School Year and Grade 



Middle School 


High School 
Grade 1 U Grad 


Cohort and Year 
Year 1 (2006-07) 
Year 2 (2007-08) 


Grade 7 Grade 8 Grade 9 
Cohort! 


Cohort 1 


Cohort 1 


Cohort 1 


Cohort 


Cohort 1 


The USDE specifics that at least 50% of students served by GEAR UP funds be designated as low income 
by their eligibility for free- or reduced-price lunches. Across grant years, the campuses that participate in 
STAR have enrolled increasing proportions of low-income students. During the 2005-06 school year (the 
year prior to implementation), 68% of students enrolled in STAR middle schools and high schools were 
characterized as low income. By 2010-1 1 (the year addressed in this report), this percentage had grown to 
75%. M TEA also determined that students in STAR campuses had low rates of participation in advanced 
courscwork and postsecondary education, and that the surrounding communities lacked the family and 
community resources to support students’ postsecondary goals, which underscored the need for 
interventions focused on improving postsecondary educational outcomes. 


THE EVALUATION OF GEAR UP/STAR 


Federal GEAR UP requirements include an evaluation component focused on assessing each grant’s 
effectiveness and measuring progress toward project goals. TLA contracted the Texas Center for 
Educational Research (TCER). a nonprofit research entity, to conduct an external evaluation of the state’s 
GEAR UP/STAR project. TCER’s evaluation activities arc limited to activities designed to support STAR 
districts and cohort student outcomes, as well as some state-level GEAR UP project initiatives, and do not 
include GEAR UP partnership grants awarded to other entities in Texas. 11 ' The purpose of the evaluation 
is to understand how districts implement STAR and the effectiveness of their implementation strategics in 
preparing students for postsecondary education. To this end, the evaluation is guided by the following 
research questions: 

4. What are the characteristics of participating STAR schools, students, teachers, and parents? 

5. How is STAR implemented across participating campuses? 

6. What are the effects of STAR implementation on indicators of student achievement and college 
preparation? 


The STAR evaluation will produce six reports — one for each year the grant is implemented. 1 1 While this 
report focuses on STAR'S fifth implementation year (i.c., 2010-1 1). it includes comparisons to previous 
grant years as a means to illustrate changes over time. This chapter provides an overview of the STAR 
project, its purposes and goals, and includes a brief introduction to the partner organizations that work 
with participating schools to achieve grant goals. Ihc chapter also introduces the methodologies and data 
sources that produced the current report’s findings. 


^Percentages are drawn from Texas' Academic Excellence Indicator System (AEIS) data and arc reported for 
campuses’ full enrollment. That is. percentages are not limited to STAR cohorts. 

,0 In 2010-11. 19 GEAR IJP partnership grants and one state grant operated in Texas. 

“Annual STAR evaluation reports may be accessed at: httpi'/tcer.org’researeh'star/index.aspx 
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STAR’S PURPOSES AND RELATED GOALS 


To achieve its goal of improving students* readiness for and participation in postsecondary education. 
STAR seeks to achieve four broad purposes: 

1. Increase the information provided to students and families about postsecondary opportunities: 

2. Increase student participation in advanced academic programs; 

3. Prepare teachers and counselors to provide support for students' postsccondarv educational goals; 
and 

4. Increase parent and community involvement in school activities and planning for postsecondary 
opportunities. 

Each of these purposes is discussed in the sections that follow. 

Increased Access to Information 

While considerable research has established that most parents and students understand the value of 
postsccondarv education and hold high educational aspirations (Bridgeland. Dilulio, Streeter. & Mason. 
2008: Johnson & Duffett. 2005; Roderick. 2006). many families, particularly those from low-income 
backgrounds with limited exposure to higher education, lack the information needed to help plan for 
postsccondarv opportunities and to navigate application and admittance processes (Cunningham. Erisman, 
& Looney. 2007; Johnson & Duffett. 2005; Tierney. Bailey. Constantine. Fmkclstcin. & Hurd. 2009). 
Results from 2009 national survey of adults indicates that most Americans believe that a college 
education is essential for students to be successful, but that college opportunities arc not available for 
many students, particularly those from minority backgrounds (Immerwahr & Johnson. 2009). STAR 
strives to address skepticism about the accessibility postsccondarv educational opportunities by providing 
parents, students, and school staff w ith information about postsecondary planning and financing options, 
and by initiating discussions about college readiness and planning in the middle school grades. 

Advanced Academics 

A grow ing body of recent research linking students' high school cxpcncnccs to postsecondary enrollment 
and performance indicates that students arc most likely to be successful in college if they have 
cxpcncnccd rigorous academic preparation (Adel man, 1999, 2006; Long, Conger. & Latarola. 2012; 
Levin. Bclficld, Muennig. & Rouse. 2007: Rodcnck. Nagaoka. & Allcnsworth. 2006). According to 
Adclman (1999). a high quality and ngorous high school curriculum trumps test scores, class ranks, and 
grade point averages as the most important determinant in the likelihood of a student completing a 
bachelor's degree. A 2012 study that examined the courses taken by high school students and the effects 
of courses on postsecondary educational outcomes found that students who took ngorous courses in the 
core content areas and in foreign languages were more successful in college, and that the effects of 
ngorous courses were stronger if they were taken earlier in high school (i.e., when students w ere in the 
ninth or tenth grade). The study also found that the effects of rigorous courscwork w ere larger for low- 
income students and for students attending disadvantaged schools (Long. Conger. & Latarola. 2012). 
STAR*s focus on engaging students in rigorous courscwork goals is well aligned with this research, 
stressing the importance of challenging courses in middle school as well as high school. To ensure 
increased participation in ngorous instruction. STAR sets specific objectives for student enrollment in 
challenging classes, particularly Advanced Placement (AP) and pre-AP courses. 

Educator Preparation 

Recognizing that teachers need training and support to provide ngorous courscwork. STAR emphasizes 
professional development activities that train teachers to align instruction between grade levels (i.e., 
vertical teaming), support the use of pre-AP and AP instructional strategics, as well as to incorporate 
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rigorous curricula, such as the College Board’s SpringBoard pre-AP instructional program, in classroom 
instruction. In addition, STAR facilitates alignment between K12 and higher education by pairing 
university professors with classroom teachers working in the same curricular area in a collaborative 
mentorship arrangement known as the Faculty Fellows mentoring program. 

Family and Community Participation and Support 

While high quality teachers and rigorous courscwork provide support for students in pursuing 
postsecondary educational goals, this support is not particularly meaningful unless students take 
advantage of the educational opportunities available to them. Adelman (1999) asserts that students arc 
more likely to succeed in college when they can rely on school, parent, and community environments that 
foster educational goals and encourage academic achievement. In their 2007 review of high school 
intervention strategies designed to improve graduation rates. Levin et al. concluded that “the strongest 
programs for increasing high school graduation rates and subsequent college participation will combine 
interventions in the school with those in the family, neighborhood, and community” (p. 22). Further, 
some research (e.g., Jcyncs. 2010) has suggested that increasing parents’ expectations for student 
achievement is more important to student outcomes than increasing parents' involvement in school 
activities. ST AR focuses on building school and community cultures that hold high expectations for 
students* academic outcomes, including participation in postsecondary education. To this end. STAR 
establishes objectives for parents* awareness of and involvement in college planning activities. 

Project Goals 

In alignment with these puiposes. STAR identifies eight specific project goals for participating districts: 

1. Increase the number of underrepresented (low-income and minority) students who are prepared to 
go to college. 

2. Increase the number of limited Lnglish proficient (LEP) Hispanic students who successfully 
graduate and go to college. 

3. Strengthen academic programs and student serv ices at participating schools. 

4. Build an academic pipeline from school to college. 

5. Develop effective and enduring alliances among schools, colleges, students, parents, government, 
and community groups. 

6. Improve teaching and learning. 

7. Provide students with intensive, individualized support. 

8. Raise standards of academic achievement for all students. 

Each goal contains a set of specific objectives that outline clear criteria for the achievement of each goal 
across project years. The complete set of STAR goals and their associated objectives arc included in 
Appendix F. Goals arc referenced throughout the report chapters and arc incorporated into the 
measurement of STAR implementation presented in chapters 4 through 9. 

STAR PARTNER ORGANIZATIONS 

To assist districts in achieving the project’s purposes and goals. STAR includes a set of partner 
organizations that provide services and design activities to support grant implementation. TEA serves as 
the grant’s administrator, providing resources and funding and ensuring compliance with USDE 
requirements, and four partner organizations support STAR campuses with day-to-day implementation of 
the grant. ST AR partner organizations include : ( I ) the College of Education at Texas A&M University at 
Corpus Christi (TAMU-CC). (2) the College Board. (3) Fathers Active in Communities and Education 
(FACE), and (4) the Faculty Fellows mentoring program (TAMU-CC and TAMU-Kingsvillc[K]). Each 
partner organization is focused on the goal of preparing students to obtain a college education, and 
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ultimately to work in a career that will offer long-term financial and personal rewards. However, each 
partner brings a unique approach to achieving this goal — from providing informational services; to 
strengthening specific skill sets for students, parents, and teachers; to engaging community support. The 
sections that follow briefly introduce the STAR partner organizations. 

Texas Education Agency 

TEA acts as the fiscal agent for the GEAR UP/STAR grant, and as such, manages grants and contracts to 
STAR districts and project partners and service providers. TEA also houses the state GEAR UP office 
which supports efforts to achieve GEAR UP goals across the state, including offering GEAR UP toolkits, 
and providing networking opportunities for the 19 GEAR UP partnership grants that operate in Texas. In 
addition to facilitating ongoing communication among GEAR UP projects, partners, and schools, TEA 
staff coordinate the grant application process for STAR districts and the contract negotiation process for 
project partners. 

College of Education at Texas A&M University at Corpus Christi (TAMU-CC) 

In its role as a STAR partner, the College of Education supports two STAR initiatives: the GEAR 
UP/STAR Pre-College Outreach Center (POC) and the Faculty Fellows mentoring program. The POC 
develops activities for students, educators, and parents and acts as a liaison between students, parents, and 
colleges. The center promotes academic ngor. particularly in the areas of science and math, by providing 
training for teachers in vertical teaming and other strategies to improve college readiness. The center 
offers sessions to assist parents with financial aid and to build local community and business sponsorship 
of academics. The POC also coordinates the TAMU-CC and TAMIJ-K Faculty Fellows mentoring 
programs and implements a Student Ambassadors program that recruits TAMU-CC students to serve as 
mentors and role models in STAR schools. 

The STAR Implementation Director and four College Access Coordinators (CACs) support 
implementation efforts and develop activities for students, parents, and educators at the six districts. 
During the 2010- 1 1 school year. POC staff members provided STAR campuses with technical assistance 
and help in planning and executing college awareness activities, as well as planning for sustainability. 
CACs offices were located at participating high schools as a means to facilitate day-to-day involvement in 
grant planning and implementation activities. 

The College Board 

The College Board is a nonprofit association that assists students in preparing for and enrolling in college. 
The College Board oversees the SAT and PSAT/NMSQT college testing programs, as well as the AP 
program of college preparatory* courscwork and testing. In its STAR partnership role, the College Board 
provides training for STAR educators in successful vertical teaming, strategics for teaching AP and pre- 
AP content, and preparation for students taking the PSAT and SAT tests. The College Board also offers 
training for counselors in its Col lege Ed college awareness curriculum and provides college awareness 
materials for all cohort students. In 2010-1 1. the College Board introduced SpringBoard. a curriculum 
tailored to pre-AP courscwork. in four STAR districts, and offered training to support SpringBoard 
implementation. 

Fathers Active in Communities and Education (FACE) 

FACE offers programs designed to expand parents* awareness of college opportunities and to strengthen 
their role in students* academic outcomes and decision making. FACE also works w ith STAR educators 
to develop strategics to expand opportunities for parents* meaningful involvement in the school and to 
increase local businesses* support for academics on STAR campuses. The organization’s distinctive 
competency is its ability to engage fathers and other male figures in the educational environment. 
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Faculty Fellows Program 

Faculty at both TAMUCC and TAMU-K participate in the Faculty Fellows mentoring program, which 
pairs university faculty with middle school and high school teachers working in the same curricular area. 
University faculty participate in classroom activities and instruction and work with teachers to plan and 
implement rigorous lessons and course content. A central focus of the Faculty Fellows mentoring 
program is to introduce students to the level of academic preparation needed to succeed in college 
course work. 

DATA SOURCES 

The evaluation employs a mixed-methods research design that combines qualitative and quantitative 
approaches to analysis. Data sources include interviews with district- and campus-level administrators, 
core subject area teachers, counselors, and STAR coordinators; surveys of students, parents, teachers, and 
counselors; and demographic and performance data collected through the Texas Public Education 
Information Management System (PEIMS) and the Texas Academic Excellence Indicator System ( AEIS). 
While the data sources and data collection instruments (with some modifications) discussed in the 
following sections will be used across evaluation years, the descriptions that follow focus on data 
collected during the 2010-1 1 school year. 

Site Visits to STAR Districts 

In spring 201 1. TCER researchers visited each of the 12 campuses participating in the STAR project. Site 
visits included interv iews with district-level administrators charged w ith the oversight of STAR as well as 
interviews with campus principals, counselors, and campus-level STAR coordinators. Interviews 
addressed the fifth-year implementation of STAR, the communication of STAR goals and activities to 
key stakeholders, the role of partner organizations, plans for sixth-year implementation, and the level of 
parent and community support for students* academic goals. In addition, site visits included focus group 
interviews with a purposefully selected sample of core subject area teachers on each campus. Focus group 
discussions explored the impact of STAR on classroom instruction, including the implementation of 
vertical teams, the role of professional development and the effect of training on teachers* classroom 
practices, as well as availability and effectiveness of STAR informational resources. Teachers also were 
asked about their involvement in the Faculty Fellows mentoring program. 

Site visits also included observations in a sample of core content area classrooms in grade levels that 
enrolled STAR student cohorts in 2010-1 1 (i.c., tirades 7. 8. 9, 10, and 1 1 ). Observations generally lasted 
55 minutes and were guided by the GEAR IJP- STAR Classroom Observation Form saved in Appendix E. 
Table 1.2 presents the number of observations in each subject area conducted at STAR middle schools 
and high schools during spring 201 1 site visits. 
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Table 1.2. Number of Classroom Observations, by Subject Area and Level of Schooling, 
Spring 2011 


Subject Observed 

Middle School 
Classrooms 
(n=47) 

High School 
Classrooms 
(n=53) 

All Classrooms 
(N=100) 

n 

% 

n 

% 

N 

% 

English.* language arts and reading 

14 

1 30% 

12 

r~23% 

26 

1 26% 

Math 

13 

28% 

1. - . — i l 

13 

P25% 

26 

f 26% 

Social studies 

11 

23% 

14 

26% 

25 

1 25% 

Science 

9 

19% 

14 

26% 

23 

1 23% 


Source: Classroom observations at STAR campuses, spring 2011. 
Note. Percentages may not total to 100 due to rounding. 


Surveys 

The evaluation incorporates the results of three surv eys conducted in spring 201 1 : ( 1 ) a paper and pencil 
survey of students on STAR campuses; (2) an online survey of teachers, counselors, and librarians 
working on STAR campuses; and (3) a telephone survey of parents of students attending S TAR campuses 
during the 2010-11 school year. An overview of each survey, including response rates and the 
characteristics of survey respondents, is presented in the sections that follow. 

Student survey. Separate paper and pencil surveys for middle school and high school students were 
distributed to STAR campuses in April 2011, and campus administrators were asked to ensure that 
surveys were administered within a 6-vvcck timeframe. Surveys probed the means by which students 
obtain information about college: their study habits, participation in school and extra-curricular activities; 
familiarity w ith postsccondary educational opportunities and financing options, and educational 
aspirations; as well as students* perceptions of their parents' involvement in their school work and 
educational planning. High school students responded to a separate section addressing participation in AP 
courscvvork and exams, and high school seniors responded to a set of questions addressing their plans 
subsequent to graduation. The response rate across both middle and high schools was 60%; however, high 
school students responded at somew hat lower rates (52%) than middle school students (76%). Response 
rates also varied by individual campus (sec Tables C. 1 and D. 1 in Appendices C and D). Without 
know ing the sources of this v ariation, it is not possible to say what types of bias the differences may 
introduce to survey results. The middle and high school student surveys arc included in Appendix E. 

Although student response rates varied by school type, results presented in Table 1.3 indicate that the 
characteristics of middle and high school student survey respondents in 201 1 were largely reflective of all 
students enrolled in STAR middle and high schools in 2010-1 1 (see Table 2.2 in chapter 2). 





Table 1.3. Characteristics of Middle School and High School Student .Survey 
Respondents, Spring 201 1 


Middle School High School All Students 

Chaiactcristic/Catcgory (n= 1,784) <n=2,354) (N=4.138) 

Ethnicity 

White 

7.3% 

8.3% 

7.9% 

African American 

3.4% 

2.8% 

3.0% 

Hispanic Latino 

86.3% 

86.0% 

86.4% 

Other 

3.0"/, 

3.0% 

3.0% 

Gender 

Male 

49.7% 

50.8% 

50.3% 

Female 

50.3% 

49.2% 

49.7% 


Sources. STAR Middle School Student Survey. STAR High School Student Survey, spring 2011. 


Teacher, counselor, and librarian survey. Teachers, counselors, and librarians on STAR campuses 
responded to an online survey in April 2011. The survey’ included items addressing faculty assignments 
and background characteristics; the role of teachers, counselors, and librarians in supporting students' 
preparation for higher education: their familiarity with the GEAR UP project; and their participation in 
vertical teams and the CollegcEd resources developed by the College Board. Teachers responded to a 
separate set of items addressing the effectiveness of AP coursework and AP training, as well as their 
participation in the Faculty Fellows mentoring program. Counselors responded to a section that asked 
them to rate the level of importance they assigned to a variety of counseling tasks, as well as the 
percentage of their time spent on tasks such as assisting students with course selection, providing 
counseling on personal issues, career choices, or postsccondary educational opportunities. 

Of the 615 staff members identified as teachers, counselors, or librarians on STAR campuses. 590 
completed a survey for a response rate of 96%. The teacher, counselor, and librarian survey is included in 
Appendix E. As presented in Table 1.4. teachers comprised the largest proportion of survey’ respondents 
(94%), followed by counselors (5%). and librarians ( 1%). On average, respondents had about 1 1 years 
experience in their current position and about 7 years experience working at their current campus. A 
majority of teachers responding to the survey taught core subject area courses (59%). 
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Tabic 1.4. Characteristics of Teacher, Counselor. Librarian Survey Respondents, Spring 201 1 



Middle School 

High School 

All Respondents 

Characteristic 'Category 

(n=2 14) 

(n=376) 

(N=S90) 

I Ethnicity 

White 

32.7% 

33.8% 

33.4% 

African American 

2.3% 

3.5% 

3.1% 

Hispanic/Latino 

62.1% 

58.2% 

59.6% 

Other 

2.8% 

4.6% 

3.9% 

| Gender 

Male 

26.3% 

43.3% 

37.1% 

Female 

73.7% 

56.7% 

62.9% 

I Experience 

Average years in position 

10.1 

11.0 

10.6 

Average years at this campus 

6.6 

6.7 

6.7 

Position 

Teacher 

93.9% 

93.4% 

93.6% 

Counselor 

4.2% 

5.6% 

5.1% 

Librarian 

Araa Hoarhorc nnlu\ 

1.9% 

1.1% 

1.4% 

ouujcui Mied yicciLiici 3 uuiyj 

Math 

18.7% 

14.8% 

16.3% 

Science 

14.0% 

13.3% 

13.6% 

Englisblanguagc arts 

22.3% 

13.0% 

16.4% 

Social studies 

12.4% 

- — ■ — — ■ - 

12.4% 



12.4% 

— — — 

Self-contained (special education) 

4.7% 

■ 

3.9% 

4.2% 

■ — - — ■ - - 

Other 

28.0% 

42.4% 

37.1% 


Sifitret: STAR Teacher, Counselor, and Librarian Survey, spring 2011. 


Parent survey. A telephone survey of parents of students attending STAR campuses was conducted in 
May 2011. The survey was administered to a random sample comprised of 10% of the parents at each 
STAR campus, stratified by the number of students at each grade level. This method resulted in a sample 
of 707 parents, and 626 parents completed survey’s for a response rate of 89%. Ihc survey included items 
addressing parent involvement in their student's school, education, and college planning. Parents 
responded to items describing access to college awareness and college planning information and 
resources. Specific items addressed parent knowledge of financial aid opportunities. Parents also 
indicated the highest level of education they felt their child would complete. The survey was available in 
both English and Spanish, and Spanish speaking interviewers were available to administer the Spanish 
version. The script for the parent survey is included in Appendix E. 

Table 1.5 describes the characteristics of responding parents, and by inference, the characteristics of the 
population of parents of STAR students. Just over a third of households (35%) were single parent homes, 
and 64% of households consisted of two parents. Parents were predominately Hispanic (78%), and about 
13% of parents were White. English was spoken in 94% of households, and Spanish was spoken in 36% 
of households. The average tenure at families* current address was 1 1 years. Over half of households 
(55%) had incomes less than S35,000. 23% were between $35,000 and $75,000. and 14% of household 
had earnings of more than $75,000. 
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Table 1.5. Characteristics of Parent Survey Respondents. Spring 201 1 


Characteristic 

Middle School 
Parents 
<n=235) 

High School 
Parents 
(n=39 1 ) 

All Parents 
(N=626) 

Households. Two parent 

69.4% 

60.4% 

63.7% 

Households. Single parent 

A numivr «\t ’irv it 

28.5% 

Ilf’ 

38.1% 
12 1 

34.5% 
11 X 

• » » L 1 .1 «. C IIUIIll.'cl l/l VLUla .11 CUUCIIl uUUI C. 

Ethnicity Latino/Hispanic 

80.4% 

77.0% 

78.3% 

Ethnicity White 

■ % In nn n ■ t i t i I % n in * in \ I m a a . n « m 

11.9% 

P7«; 

14.3% 
V M V. 

1 3.4% 

titnmcitv Atncan American 

r 

College attendance 

A Vt'i'iot* niinirVM* i\t 'irv r\l tAlIr'tTi* 'ill^ntl'itv*/* 

i . / * 
54.9% 

■ fir 

47.1% 
* fy 

1.1 to 

50.0% 
3 1 

IIUlIll’wl l/l \ C. .U > Ul tUHLLt dUUIUdllll 

Household income less than $35,000 

48.9% 

■ 1 ■ ■ ■ 

58.3% 

54.8% 

Household income between S35.000 and $75,000 

Unuritimlrl tnrnmn i U , n C*1C ll/Vl 

23.8% 

1*7 e/v 

22.3% 
t V IKV. 

22.8% 
1 A 1 O’ 

Houscnoia income more tnan 
English spoken at home' 

94.S% 

\l.\rk 

93.6% 

14. 1 
93.9% 

Spanish spoken at home* 

34.0% 

37.6% 

36.3% 


Sifurce: STAR Parent Survey, spring 2011. 

AW. Percentages across categories <e.g.. ethnicity, household income) may not total to 100. Some parents did not 
iespond to certain questions. 

J Some parents responded that both English and Spanish were spoken in the home. 

Demographic and Performance Data 

'11k evaluation relies on demographic and performance data collected primarily from TEA'S archival 
databases: PE1MS and AEIS. PE1MS is an archival database that contains all data collected from Texas 
public schools by TEA. PE1MS includes student demographic and academic performance data, as well as 
information about school staffing, finance, and organization. AEIS is an archival datahasc that contains 
information about the academic performance and accountability rating of each public school district and 
campus in Texas. Some analyses also incorporate data included in TEA’s public school directory, known 
as AskTED. Results arc presented for STAR campuses and include comparable findings for TEA- 
identified peer-comparison campuses 1 * and statewide averages for purposes of comparison. 

THE ONGOING EVALUATION 

'11k results presented in this report comprise the fifth-year findings for the evaluation of the STAR 
project. The ongoing evaluation will continue to gather data across the project's sixth (2011-12) 
implementation year, including survey and site visit data and demographic and performance data 
collected by 'TEA. As the lead STAR cohort progresses through high school, the evaluation will focus on 
how districts’ implementation strategics change in order to meet the needs of students with immediate 
college planning needs and how districts' efforts may affect students’ postsccondary outcomes. In 
addition, the evaluation will consider how distnets plan to sustain the implementation of STAR'S reforms 
when funds expire in 2012 . 


'^TEA-identificd peer companion campuses serve student populations that ate similar those served by GEAR 
UP/STAR campuses. 
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Chapter 2 

The Characteristics of STAR Schools 


'Ihc evaluation's first research question addresses the characteristics of STAR schools and the cohorts of 
students receiving STAR services (i.c.. students in Grades 7 through 1 1 in 2010-1 1 ). Using demographic 
and performance data collected primarily from TEA's PEIMS database and AEIS reports, this chapter 
presents information about STAR districts and campuses, including school size, and the characteristics of 
students and staff. Analyses incorporate comparisons of STAR schools to statewide averages. 

CHARACTERISTICS OF STAR DISTRICTS AND CAMPUSES 

'Ihc following sections describe the characteristics of STAR districts and campuses and rely primarily on 
data provided through TEA’s AEIS reports for the 2010-1 1 school year. 

Districts and Schools 

Six school distnets in the Gulf Coast area that enroll predominantly low-income. Hispanic students 
participate in the STAR project. Each school district includes a feeder system with at least one middle 
school and one high school. A feeder system, or vertical feeder pattern, includes middle schools that send 
students to a particular high school. .As Table 2. 1 shows, the 12 participating campuses include six mid- 
level schools (three schools serving Grades 7 and 8 and three serving Grades 6 to 8) and six high schools. 
Enrollment in STAR schools varied widely. On average, mid-level schools had fewer students (474 
students) than high schools (764 students). Since 2000-01. overall enrollment in STAR schools has 
decreased from 9,350 students to 7.424 students, or a decrease of 20.7%, and enrollment decreases have 
tended to be steeper at the high school than at the middle school level (24.6% vs. 13.5%) (see Figure 2.1 ). 

As noted in chapter 1. STAR is implemented in an add-a-cohort model that began with a lead cohort of 
Grade 7 students in 2006-07, and expands to include additional grade levels as students progress. During 
the 2010-1 1 school year, the lead group of Grade 7 students was in Grade 1 1 and the STAR cohort had 
expanded to include students in Grades 7 through 1 1 — totaling just under 5,000 students. Table 2.1 shows 
the percentage of students by campus served by STAR in 2010-1 1. and indicates that 83% of mid-level 
students and 80% of high school students at STAR campuses were part of the cohort. Overall, 81% of 
students at the 12 STAR campuses were part of the STAR cohort during the 2010-1 1 school year. 





Table 2.1. Student Enrollment for STAR Campuses. 21)10-1 1 


Campus 

Number of 
Students 

Number of 
Cohort 
Students’ 

Percentage of 
Cohort 
Students 

Mid- Level Schools 

Falfurrias Junior High (6-8) 

339 

232 

68% 

Adams Middle School (7-8) 

Sl6 

816 

100% 

Memorial Middle School (7-8) 

Tl2 

512 

100% 

Driscoll Middle School (6-8) 

608 

398 

65% 

Mathis Middle School (7-8) 

333 

225 

68% 

Odcm Junior High (6-8) 

234 

166 

71% 

Group Average 

474 

392 

- 

Group Total 

2,842 

2,349 

83% 

High Schools 

Falfurrias High School 

402 321 

80% 

Alice High School 

1450 

1184 

82% 

H. M. King High School 

1024 

849 

83% 

Miller High School 

979 

743 

76% 

Mathis High School 

433'; 

342 

79% 

Odcm High School 

294 

238 

81% 

FW ■ ' T 1 ." ' M 

764 

613 


L W r~- I 

4.582 




619 



Overall Total 

7.424 

6.026 

81% 


Source: Student enrollment (7,424) from 201 1 Academic Excellence Indicator System (AEIS) 
campus student statistics data file. 

Tirades 7 through 1 1 . 



Middle School High School Total 


Figure 2.1. STAR middle school, high school, and total enrollment. 2001-2011. 

Sources: Texas Education Agency 2001 through 201 1 Academic Excellence Indicator System (AEIS) campus 
student statistics data files. 
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Student Cohort Characteristics 


Figure 2.2 compares the demographic characteristics of students included in the STAR cohort in 2010-1 1 
(i.c., student in tirades 7 through 1 1) with state averages, and indicates that the STAR cohort was 
comprised of a larger proportion of Hispanic students than the state as a whole (89% vs. 47% for the 
state) and a notably smaller proportion of White (8% vs. 34%) and African American students (3% vs. 
13%). Relative to state percentages, a larger percentage of STAR cohort students were characterized as 
economically disadvantaged (75% vs. 53%) and a smaller percentage were limited English proficient, or 
LHP (2% vs. 8%). 



African American Hispanic White Eeo. Dis. LEP 


■ STAR Cohort ■ State 


Figure 2.2. STAR cohort characteristics, 2010-1 1. 

Sources. Texas Education Agency 201 1 Public Education Information Management System (PEIMS) individual 
student demographic data tile. State percentages were calculated from Texas Education Agency Academic 
Excellence Indicator System (AEIS) 201 1 campus student statistics data file. 

Notes. STAR cohort students were in Grades 7 through II in 2010-1 1. State percentages were calculated using 
counts of students in each group. State percentages excluded STAR campuses and included campuses with grade 
types ’‘middle” and "secondaty.” The majority of grade type “middle" campuses spanned Grades 6 to 8. Tlie 
majority of grade type "secondary” campuses spanned (trades 9 through 12. 








Tabic 2.2 reports the ethnic distribution of cohort students by campus and illustrates that in 
2010-1 1 cohort students at each STAR campus were predominantly Hispanic and economically 
disadvantaged. 


Table 2.2. Student Cohort Characteristics. 2010-1 1 


Campus 

Percent 

African 

American 

Percent 

Hispanic 

Percent 

White 

Percent 

Eco. 

Disadv. 

Percent 

LEP 

Mid-Level Schools 

I 4 5%l turTifi^ lunt nr Hi on 

0 0% 

98 7% 

09% 

82 8% 1 3 0% 

• UlllUl 1410 J Ulillrl 1 ll»U 

Adams Middle School 

0.2% 

92.2% 

7.0% 

72.1% i 2.3% 

Memorial Middle School 

4.7% 

84.2% 

9.6% 

73.8% 

1.2% 

Driscoll Middle School 

8.0% 

86.2% 

4.3% 

90.2% 

1.8% 

Mathis Middle School 

2.7% 

92.0% 

5.3% 

84.9% 

1 .8% 

Odcm Junior High 

6.0% 

83.1% 

16.9% 

59.0% 

0.6% 

Group Percentage* 

2.7% 

89.4% 

7.0% 

76.9% 

1.9% 

High schools 

Falfurrias High School 

0.0% 

97.2% 

2.2% 

89.1% 

1.2% 

Alice High School 

0.3% 

93.2% 

6.1% 

65.7% 


H. M. King High School 

3.9% 

80.6% 

13.8% 

70.1% 

mtijm 

Miller High School 

7.0% 

88.2% 

3.6% 

85.7% 


Mathis High School 


89.2% 

9.6% 

80.7% 

0.6% 

Odcm High School 

mmm 

81.5% 

17.2% 

60.1% 

0.4% 

Group Percentage* 


88.5% 

8.1% 

73.8% 

2.0% 

GEAR UP Percentage* 

MUM ■ 

88.8% 

7.7% 

75.0% 

1.9% 

State Percentage* 

13.4% 

47.4% 

33.6% 

53.3% 

7.7% 


Sources: Texas Education Agency 201 1 Public Education Infoiniaiion Management System (PEIMS) individual 
student demographic data file. Slate percentages were calculated from Texas Education Agency Academic 
Excellence Indicator System (AEIS) 201 1 campus student statistics data file. 

Note. STAR cohort students were in Grades 7 through 1 1 in 2010-1 1. 

■Group and STAR percentages were calculated using counts of students in each group. 

* State percentages excluded STAR campuses and included campuses with grade types "middle" and "secondary" 
only. The majority of grade type "middle" campuses spanned Grades 6 to X. The majority of grade type 
"secondary” campuses spanned Grades 9 to 12. Percentages were calculated using counts of students. 

Educational Programs 

Figure 2.3 and Table 2.3 present information on cohort students participating in educational programs 
designed to meet specific educational needs, such as special education and gified and talented programs, 
'fhc average percentage of cohort students enrolled in special education was 14% which is higher than the 
state average of 10%. A smaller percentage of cohort students were enrolled in bilingual ' English as a 
Second Language (ESL) progrants than students statewide (2% vs. 7%). fhc percentage of cohort 
students enrolled in gifted and talented programs in STAR schools was slightly lower than the state 
percentage (8% vs. 10%). 
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100% 



i? 
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90% 
80% - 
70% - 
60% - 
50% - 
40% - 


30% f 



Special Ed. 



Bilingual ESL GT 


■ STAR Cohort ■ Slate 


Figure 2.3. Cohort students participating in special programs, 2010-11. 

Source y. Texas Education Agency 201 1 Public Education Information Management System ( PEIMS) individual 
student demographic data file. State percentages were calculated from Texas Education Agency Academic 
Excellence Indicator System <AEIS| 201 1 campus student statistics data file. 

Notes. STAR cohort students were in Grades 7 through II in 2010-1 1. State percentages were calculated using 
counts of students in each group. State percentages excluded STAR campuses and included campuses with grade 
types "middle” and "secondary.” TIk majority of grade type "middle” campuses spanned Grades 6 to 8. Tlie 
majority of grade type "secondary” campuses spanned Grades 9 to 12. 
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Tabic 23. Cohort Students in Special Programs. 20 10-11 


Campus 

Percent 

Special 

Education 

Percent 

Bilingual/ESL 

Percent 
Gifted and 
Talented 

| Junior High and Middle Schools 

Falfurrias Junior High ! 

9.1% 

| 2.6% 

8.6% 

Adams Middle School | 

8.9% 

~j 2.2% 

11.9% 

Memorial Middle School 

9.0% 

0.8% 

9.4% 

Driscoll Middle School j 

14. 1% 

1.5% 

0.0’/. 

Mathis Middle School 1 

f \ ( l. m 1 imtivr Utnk 

12.0% 
1 ! r!Q/. 

0.9% 
A A'*/. 

4.9% 

1 i 8" 

vxictn Junior Hign 
Croup Percentage* 

1 1.4/0 
103% 

U.O /o 
1.6% 

1 i.i /« 

8.4% 

High Schools 

Falfurrias High School 1 

18.1% 

1.2% 

12.1% 

Alice High School | 

1 1 3% 

23% ~ 

12.4% 

H. M. King High School j 

11.7% 

1.2% 

5.4% 

Miller High School 1 

22.6% — 

2.7% ~ 

03% 

Mathis High School | 

123% 

03% 

4.1% 

Odcm High School | 

14.7% 

0.0% 

7.6% 

Group Percentage* 

14.6% 

1.7% 

7.2% 

GEAR UP Percentage* 

12.9% 

1.6% 

7.7% 

State Percentage* 

9.8% 

73% 

10.2% 


Sources: Texas. Education Agency 201 1 Public Education Infointation Management System 
(PEIMS) individual student demographic data file. State percentages were calculated from 
Texas Education Agency Academic Excellence Indicator System (AEIS) 201 1 campus student 
statistics data file. 

Note. STAR cohort students were in Grades 7 through II in 2010- 1 1 . 

'Group and STAR percentages were calculated using counts of students in each group. 

'State percentages excluded STAR campuses and included campuses w ith grade types "middle” 
and "secondary" only. The majority of grade type "middle" campuses spanned Grades 6 to 8. 
The majority of grade type "secondary" campuses spanned Grades 9 to 12. Percentages w ere 
calculated using counts of students. 
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Teacher Characteristics 


Tabic 2.6 provides data showing that STAR teachers, on average, had approximately 12 years teaching 
experience, which was about the same as the state average (12 years); STAR average teacher experience 
varied from 9 to about 16 years by campus. S TAR campuses enrolled a somewhat smaller percentage of 
beginning teachers than the state (6% vs. 7%). However, about 20% of teachers at Mathis High School 
were in their first year of teaching m 2010-1 1. which is more than tnplc the average of other STAR 
campuses and more than double the state average. The percentage of minority teachers working at STAR 
campuses ranged from 45% at Odem High School to 91% at Falfurrias High School. In STAR middle 
schools, instructional aides represented a slightly higher percentage of the total staff ( 14%) compared to 
the percentage of aides in STAR high schools ( 1 0%) and the state as a whole ( 1 1%). 


Table 2.4. STAR Teacher Characteristics. 2010-11 


C ampus 

Number 

Average 

Years 

Teacher 

Experience 

Percent 

Beginning 

Teachers 

Percent 

Minority 

Teachers* 

Percent 

Instructional 

Aides 

| Junior High and Middle Schools 

Falfurrias Junior High 

29 

15.1 

3.5% 

86.0% 

17.7% 

Adams Middle School 

63 

9.0 

10.1% 

62.9% 

10.6% 

Memorial Middle School 

57 

11.4 

5.4% 

70% 

16.9% 

Driscoll Middle School 

42 

12.7 

2.4% 

60.6% 

14.0% 

Mathis Middle School i 

24 

12.2 

4.1% 

55.4% 

12.4% 

Odem Junior High 1 

20 

10.0 

9.8% 

59.2% 

14.0% 

i ■ ■ - ■ ■ — ■ — 

Group Average 

36 

11.7 

5.97c 

67.17, 

14.37, 

High Schools ~ 

Faliurrias High School | 

33 

15.5 

6.0% 

90.9% 

9.1% 

Alice High School 

118 

12.4 

5.4% 

58.7% 

8.3% 

H. M. King High School 

if 

13.5 

5.5% 

67. T%~~ 

12.0% 

Miller High School 

84 

10.0 

2.4% 

63.8% 

12.8% 

Mathis High School 

37 

8.9 

19.7% 

60.0% 

8.2% 

Odem High School 

26 

J5-* 

0.0% 

45.1% 

1 1 .3% 

(•roup Average 

62 

12.6 

6.57c 

64.37c 

10.37c 

STAR Average 

49 

12.2 

6.27c 

65.77, 

12.37c 

State Average' 

50 

11.7 

7.37c 

35.67, 

10.87c 


Source: Texas Education Agency Academic Excellence Indicatoi System 201 Icampus staff statistics data file. 
'Minority includes all non-white groups. 

*Group and STAR percentages were calculated using counts of leaders and staff in each group. 

■ Slate percentages excluded STAR campuses and included campuses with grade types “middle" and “secondary" 
only. The majority of grade type “middle" campuses spanned Grades 6 to 8. The majority of grade type 
“secondary" campuses spanned Grades 9 to 12. Percentages w ere calculated using counts of teachers and stall'. 
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SUMMARY 


'Ihis chapter has provided information about the characteristics of STAR districts and campuses, 
including staff and cohort students, and included comparisons to state averages. STAR cohort students 
were in Grades 7 through 1 1 in 2010-1 1. Overall. 81% of students at STAR campuses participated in 
STAR services during the 2010-1 1 school year, including 83% of middle school students and 80% of high 
school students. 

Relative to state averages, the STAR cohort was made up of substantially larger proportions of Hispanic 
students (89% vs. 47%) and low-income students (75% vs. 53%). Correspondingly, the cohort was made 
up of smaller proportions of African American (3% vs. 13%) and White (8% vs. 34%) students than other 
Texas middle and high schools. Despite its concentration of Hispanic students, the STAR cohort included 
lower proportions of LEP students (2% vs. 8%) than middle and high schools statewide in 2(8)9-10. 

In terms of special educational programs, proportionately more cohort students participated in special 
education ( 13% vs. 10%) than Texas middle and high schools, on average. Similar to results for LEP 
students, proportionately fewer cohort students in participated in bilingual and iiSL programs than the 
state average for middle and high schools (2% vs. 7%). 
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Chapter 3 

STAR Performance Indicators 


lhc STAR project attempts to improve the academic preparation of students with a goal of increasing the 
number of students who pursue higher education opportunities. To measure progress toward this goal, this 
chapter compares fifth year data ( 2010 - 1 1 ) with baseline data across several important academic 
indicators, lhc chapter utilizes data provided through TEA's AEIS database and includes measures 
related to accountability ratings and performance on the Texas Assessment of Knowledge and Skills 
(TAKS) examinations. Results are reported across indicators for STAR cohort students and. where 
appropriate, for THA-idcntificd “peer group*' campuses. 1 < as well as state averages for purposes of 
comparison. The focus is on five groups or cohorts of students. Cohort 1 includes students who were in 
Grade 11 in 2010-1 1 and in Grade 6 in their baseline year of 2005-06. Cohort 2 students were in Grade 10 
in 2010-1 1 and in Grade 6 in their baseline year of 2006-07, Cohort 3 students were in Grade 9 in 2010- 
1 1 and in Grade 6 in their baseline year of 2007-OX, Cohort 4 students were in Grade 8 in 2010-1 1 and in 
(irade 6 in their baseline year of 2008-09. and Cohort 5 students were in Grade 7 in 2010-1 1 and in Grade 
6 in their baseline year of 2009-10. 

Note that Appendix 1 compares 2009-10 data with 2005-06 data across a wide variety of academic 
indicators that are benchmarks against which districts* progress toward STAR goals may be. It is 
important to note that these data reflect the performances of all students in STAR schools and arc not 
specific to cohort students. 

STAR CAMPUS ACCOUNTABILITY INDICATORS 
Accountability Ratings 

Under the Texas accountability system, campuses are assigned one of four ratings — Exemplary . 
Recognized* Academically Acceptable* and Academically Unacceptable — which arc largely based on 
TAKS performance, completion rates, and dropout rates. Data presented in fable 3. 1 indicate that across 
implementation years, most STAR campuses have been rated Academically Acceptable; however, in 
2010-11, two middle schools and four high schools received the Academically Unacceptable rating. 


Table 3.1. STAR Campus Accountability Ratings, 2005-06 Through 2010-11 


Rating 

05-06 

06-07 

Middle Schools 
I 07-08 08-09 

09-10 

10-11 

05-06 

06-07 

High Schools 
07-08 08-09 

09-10 

10-1 

Exemplary 

R*vrK»nr/rd 

0 

n 

0 

o 

0 

o 

0 

o 

0 

2 

0 

(1 

0 

0 

5 

0 

0 

0 

6 

0 

0 1 

0 

2 

0 

(I 

Acceptable 

6 

v 

5 

5 

6 

4 

4 

4 

5 

5 

3 

2 

Academically 

Unacceptable 

0 

1 

1 

0 

0 

2 

1 

2 

1 

1 

1 

4 


Sources: 2005-06 through 2010-1 1 Academic Excellence Indicator System (AEIS) campus reference files. 


11 For each campus in tlw state. TEA has created a peer or comparison group of 40 public school campuses selected 
on the hasis of six student demographic characteristics, including the percentages of African American. Hispanic, 
and White students, the percentage of economically disadvantaged students, the percentage of limited English 
proficient students, and the campus mobility rate (TEA. 2007). For a specific performance indicator. TEA reports 
the median value of the 40 comparison campuses on that indicator. Thus, peer groups allow for comparisons of 
campus performance for similar schools. 
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TAKS Performance 


Although STAR is not specifically focused on TAKS preparation and tutoring, the evaluation includes 
information on students' TAKS performance as a measure of academic progress and overall learning, 
fable 3.2 compares the five cohorts of students on STAR campuses with peer campus and state averages. 
Comparisons focus on baseline year 11 to 2010-1 1 changes for each group. For each group of students, 
average baseline to 2010-1 1 changes followed the same overall trends as peer campuses and the state 
overall, although the magnitude of changes varied by cohort and comparison group. For example, 
students in Cohort 1 experienced gains for “all tests taken." reading* FLA. and mathematics tests that were 
similar those of peer campuses but exceeded state averages. Like peer campuses and state average, 
students in the remaining STAR cohorts either had no change or saw declines in their TAKS passing 
rates, but no clear pattern emerges relative to peer campuses or the state average. 


,4 As stated earlier. Cohort I students were in Grade 11 in 2010-1 1 and in Grade 6 in their baseline year of 2005-06. 
Cohort 2 students were in Grade 10 in 2010-1 1 and in Grade 6 in their baseline year of 2006-07. Cohort 3 students 
weie in Grade 9 in 2010-1 1 and in Grade 6 in their baseline year of 2007-08. Colton 4 students were in Grade 8 in 
2010-1 1 and in Grade 6 in their baseline year of 2008-09. and Colton 5 students were in Grade 7 in 2010-1 1 and in 
Grade 6 in their baseline year of 2009-10. 
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SUMMARY 


This chapter reported STAR campus accountability ratings from 2006 through 201 1. In addition, archival 
data gathered from the TEA's AEIS data system was used to present baseline to 201 1 TAKS comparisons 
for the five STAR student cohorts. Although Cohort 1 experienced gains in TAKS passing rates in 2010- 
1 1 . the remaining cohorts either saw no change in passing rates or experienced declines. This pattern also 
was evident for peer campuses and the state as a whole. Correspondingly, half of STAR campuses (i.c., 
four high schools and two middle schools) received the accountability rating of Academically 
Unacceptable in 2010-1 1. 
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Chapter 4 

Measuring STAR Implementation 


In an attempt to understand why programs designed to improve student achievement outcomes succeed or 
fail, researchers arc increasingly focusing on the manner in which schools implement their programs. 
Considerable research has demonstrated that the quality of program implementation is closely associated 
with student outcomes and that teacher buy-in and support as well as district and campus level 
commitment to program goals arc important to implementation quality (Berman & McLaughlin, 1978; 
Qifulco. Duncombc, & Yingcr, 2005; Borman, 2005; Borman, Hewcs, Overman, & Brown. 2003; 

Datnow, Borman. & Stnngficld. 2000; Verne/-. Karam. Mariano. & DcMartim. 2006: Yap. 1996). 
Recognizing that educational programs are unlikely to produce their desired outcomes if they arc 
implemented partially, or not at all. researchers have developed methodologies designed to measure the 
degree to which schools implement the core components of the educational programs they adopt, or the 
fidelity of implementation. Such methodologies rely heavily on data collected through surv eys of program 
stakeholders as well as observations of program implementation in classrooms or other educational 
settings. 

Researcher* at RAND designed an approach to measuring the implementation of models of 
Comprehensive School Reform, or CSR. that relies on survey and observational data to (1 ) measure the 
degree to which individual components of a CSR model were implemented in participating schools, and 
(2) provide an overall measure of program implementation derived from aggregated (averaged) measures 
of model components (Vcmcz, Karam. Mariano. & DcMartini, 2006). In developing its approach to 
measuring implementation. RAND first identified the key components of each CSR model it considered 
and translated components into “a set of model requirements, practices, and support activ ities that a 
school should have or do in order to faithfully implement the model in all of its dimensions*’ (emphasis in 
original, p. 20). Then researchers specified the criteria that defined the full implementation of each model 
component and its related supporting components, as well as survey items that measured the degree to 
which components were implemented. Survey results were standardized in order to facilitate the 
comparison across different types of indicators (c.g., categorical, scale, or continuous response items). 
Standardized scores were then used to measure the degree to which individual CSR model components 
were implemented relative to maximum score values (i.e., the score representing full implementation). 
This process enabled researchers to produce ( 1 ) an overall implementation score for each core and 
supporting component of the CSR model. (2) an overall implementation score for the key CSR model 
components, and (3) an overall implementation score derived from the averaged scores of key component 
scores (p. 33). 

While the advantage of this approach is that it is applicable across a large number of schools and 
facilitates the measurement of similar practices in different schools. RAND notes that it has some 
important limitations. Constraints on survey length limit researchers* ability to measure all aspects of 
model implementation and researchers arc not able to gather complete information on classroom 
instruction. Despite these limitations. RAND asserts that “our approach permits us to measure variations 
in the lev el of implementation** and to make comparisons between schools (p. 34). 

MEASURING THE IMPLEMENTATION OF STAR 

lhc measurement of STAR implementation presented in this evaluation incorporates RAND’s 
methodology and suffers from some of the same limitations. As discussed in this section, the 
measurement of STAR implementation relics heavily on survey data. and. as RAND notes, constraints on 
survey length prevent researchers from gathering complete information about the programs they study. In 
addition, the evaluation incorporates data collected during classroom observations conducted in the spring 
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of each evaluation year. While classroom observations provide valuable data on instructional activities 
and student engagement, it is unlikely that a single observation conducted at one point in time can identify 
the depth of instruction that takes place in a teacher’s classroom in a school year. In light of these 
limitations, readers arc asked to recognize that the measurement of STAR implementation is not able to 
capture all aspects of implementation, but it provides a useful approach to understanding variations in the 
level of implementation across schools and grant years. 

The Approach to Measuring STAR Implementation 

Following the approach outlined by RAND, researchers first identified the core components of STAR 
implementation based on the program’s broad purposes. As discussed in chapter 1. these core components 
include: 

1. Raising Academic Standards. 

2. Engaging Teachers and Students. 

3. Increasing Student and Parent Access to Information, and 

4. Building School and Community Cultures that Support Academic Achievement. 

Because STAR districts did not receive grant funding until late in the fall 2006 semester, most districts 
did not begin to implement the program until spring 2007. Given STAR'S abbreviated first-year 
implementation period, the measurement of implementation begins in STAR'S second year (2007-08) 
when districts were fully implementing the program. 

In developing the approach to measuring STAR implementation, researchers reviewed relevant research 
and STAR’s eight goals (sec Appendix F) to identify and define the supporting components for each of 
the core components listed above. Once supporting components were defined, researchers revised data 
collection instruments to gather information measuring the degree to which supporting components were 
present in STAR schools. Central to this task was the development of survey items and classroom 
observation instruments that measured the varied dimensions of supporting components. 

In the spring of each evaluation year, surveys are administered to teachers, counselors, and librarians: 
middle and high school students: and parents of students attending STAR campuses. Characteristics of 
spring 201 1 survey respondents and response rates arc presented in chapter 1 . In addition, researchers 
conduct classroom observations at each STAR campus during site visits conducted in the spring of each 
evaluation year. Following RAND’s model, classroom observation data and survey items are standardized 
to enable comparisons across different scales. In collaboration with TEA staff and program 
administrators, researchers identified the criteria that define whether supporting components have been 
implemented to a ( I ) minimal , (2) partial , (3) substantial, or (4) full degree. 

The section that follows describes each core component of STAR implementation and its related 
supporting components. Most supporting components are made up of a set of indicators measured by 
survey instruments, classroom observations. PEIMS data, and so on. Indicator scores arc averaged to 
produce an aggregate implementation score for each supporting component. In turn, supporting 
component scores arc averaged to produce an aggregate implementation score for each respective core 
component, and core component scores arc averaged to produce an overall, or aggregate, implementation 
score (see Figure 4.1). Report chapters present aggregate findings for STAR middle schools and high 
schools, as well as overall program implementation across implementation years. For more specific 
information on the data sources used to measure each STAR component and the indicators that make up 
each supporting component, please see fable G.l in Appendix G. 
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Raising Academic Standards 


Research has consistently indicated that the strongest indicator of the likelihood that a student will be 
successful in postsecondary educational opportunities is the rigor of their academic preparation 
(Adelman. 1999, 2006: Levin, Bel field, Muennig, & Rouse, 2007; Roderick, Nagaoka, & Allensworth, 
2006). In order to improve students* preparation for postsccondarv opportunities, STAR focuses on three 
supporting components of increasing academic standards: ( I ) Academic Rigor. (2) Curriculum Alignment , 
and (3) Advanced Academics. 

Academic rigor. In its focus on increasing the rigor of classroom instruction, STAR provides 
professional development for teachers in implementing AP strategics in all core content classrooms and in 
working in vertical teams to align instruction between grade levels. As teachers learn to implement 
techniques designed to increase the rigor of instruction, students arc expected to become more engaged in 
learning and experience improved academic outcomes. The measurement of academic rigor in STAR 
classrooms uses data collected during classroom observations in a sample of core content classrooms in 
STAR middle and high schools in the spring of each evaluation year. Researchers complete observations 
using an instrument that measures the degree to which instructional activities incorporate higher order 
thinking skills, as well as subject-specific indicators of rigorous instruction drawn from College Board 
materials, fable 1 .2 in chapter 1 presents the number of observations conducted by subject area and 
school type in spring 2011 , and the evaluation's classroom observation instrument is included in 
Appendix E. 

Curricular alignment. In order to support teachers in improving students' academic achievement, the 
College Board offers vertical team training to faculty on all STAR campuses. While the College Board's 
professional development curriculum is designed to instruct teacher* in strategics that support students 
enrolled in AP courscwork. the training is applicable to non-AP content and is offered to all con: content 
area teachers. In addition, the College Board offers training designed to support vertical teams among 
middle school and high school counselors. 

The College Board defines a vertical team as: 

...a group of educators from different grade levels in a given discipline who work cooperatively to 
develop and implement a vertically aligned program aimed at helping students acquire the academic 
skill necessary for success in the Advanced Placement Program and other challenging coursework 
(College Board. 2004. p.3>. 

The College Board training assists teachers and counselors in working collaboratively to develop 
instructional plans that build on one another to create a vertically articulated path through course content. 
The measurement of curricular alignment uses items from the teacher survey that address teachers’ use of 
vertical team strategies and participation in vertical team meetings. 

In 2010-1 1. the POC contracted with an independent consultant to provide additional support for 
curricular alignment on STAR campuses. 'Ihe POC consultant visited STAR districts four times over the 
course of the year and worked with district staff to develop training and support tailored to individual 
districts* curricular alignment and vertical teaming needs. During district visits, the consultant also 
worked with teachers to develop classroom strategies and routines that support rigorous instruction and 
met with administrators to encourage the use of vertical teams to align curriculum and improve 
instructional ngor. 

Advanced academics. As part of efforts to increase the rigor of instruction for low-income and minority 
students, there has been a push to increase the number of such students enrolled in AP courscwork. 
However, research indicates that the benefits of AP courscwork accrue only to students who are able to 
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pass A l 1 exams and that there is little value in extending AP classes to students who arc unprepared for 
challenging courscwork or in watering down course content to ensure broader student participation 
(Cieiser & Santeliccs, 2004; Dougherty. Mcllor. & Jian. 2006). In recognition of this research, the 
approach to measuring advanced academics in STAR high schools incorporates three indicators: (I) the 
percentage of students in STAR high schools who participate in advanced courses drawn from TEA 
Course Completion Records, and College Board data indicating (2) the percentage of students in STAR 
high schools who participate in AP exams, and (3) the percentage of AP exants that cam a score of 3 or 
higher. 

Engaging Teachers and Students 

STAR seeks to engage teachers and students in achieving program goals through targeted grant activities. 
Teachers are provided with opportunities to participate in high quality professional development offered 
by College Board and POC consultants, and schools are expected to offer a range of activities to increase 
student engagement in achieving academic goals. In measuring student and teacher engagement, the 
evaluation identified two supporting components ( 1) Teacher Engagement in Professional Development 
Activities and (2) Student Engagement in Sduxding. 

Teacher engagement in professional development activities. In support of the curricular alignment 
goals discussed in the previous section. STAR provides teachers with the opportunity to participate in 
high quality professional development activities offered by the College Board and the Model Classroom 
Project (MCP), and four STAR districts are using GEAR L'P funding to support the implementation of the 
Advancement Via Individual Determination, or AVID, program, which offers training for teachers in 
preparing and motivating underserved students for postsccondary opportunities. In order to measure 
teachers* participation in professional development opportunities, the evaluation uses information 
collected through the spring surveys of teachers. 

In 2010-1 1. College Board professional development activities focused on improving teachers' skill in 
designing and implementing ngorous instruction and in collaborating with colleagues. MCP training 
focused on the development of instructional leadership skills for campus administrators and MCP 
consultants worked in classrooms coaching teachers' use of techniques focused on increasing 
instructional ngor. Some teachers in districts implementing AVID participated in training focused on 
providing students with the study habits and organizational skills needed to he academically successful. 

Student engagement in schooling. The evaluation relies on student survey data addressing students* 
participation in a range of school activities focused on improving academic outcomes (c.g.. tutoring, 
mentoring, study skills workshops, etc.), as well as student attendance rates available through Texas* 
PE1MS archival database. 

Increasing Student and Parent Access to Information 

Recognizing that many low-income families lack the information needed to effectively plan for and take 
advantage of postsccondary educational opportunities. STAR seeks to increase parents* and students* 
access to postsccondary planning information. In measuring this component of STAR, the evaluation 
identified two supporting components: ( 1 ) Student Access to Information and (2) Parent Access to 
Information. Both components arc measured using information gathered through spring surveys of 
parents and students, and the measurement of Student Access to Information also includes partner- 
collected data addressing student participation in informational programs. 
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Building School and Community Cultures That Support Academic Achievement 

STAR also seeks to support academic outcomes by building school and community cultures focused on 
student achievement. The STAR partner organization FACE offers programs that engage parents, 
students, and the larger community in school activities. In measuring the degree to which school and 
community cultures provide support for student outcomes, the evaluation considers two supporting 
components: < I ) School Environment and (2) Parent and Community Support 

School environment. As a means to measure the degree to which school environments provide strong 
support for student achievement, the evaluation relics on data collected through spring teacher surveys 
that address school leadership, staff buy-in and support for STAR goals, and whether schools support 
innovative cultures that encourage new approaches to instruction. 

Parent and community support. Parent and community support for student achievement arc measured 
using data collected through spring survey's of teachers and parents. Surv ey items focus on the level of 
parent support for students* academic goals as well as parent and community involvement in school 
activities. 
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SUMMARY 


'Ihis chapter provided an overview of the methodology used to measure ( 1 ) the overall implementation of 
STAR in participating schools, (2) the implementation of STAR'S four core components, and (3) the 
implementation of varying dimensions of core components, or supporting components. In disaggregating 
implementation scores by core and supporting components, the evaluation seeks to provide a means to 
identify areas of strength and weakness in district and campus implementation strategies and to provide a 
useful tool to measure districts* progress over time. 
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Chapter 5 

Raising Academic Standards 


A primary objective of STAR is to raise academic expectations for all students in order to increase the 
number of students “who are prepared to enter and succeed in postsecondary education" (TEA, 2006; 
IJSDE, 1998). To achieve this goal. STAR schools are expected to increase academic ngor through 
instructional and curricular reform, and students in STAR schools arc encouraged to participate in 
advanced courses. The USDE's 2008 evaluation of GEAR UP programs nationally emphasized the 
importance of intensive instructional reform, noting that only programs which successfully increased 
academic rigor experienced improved student outcomes. However, research has found that effecting 
instructional change is a particularly challenging component of school reform (Vcmcz, Karam. Mariano. 
& DcMartini, 2006). 

As a means to measure STAR campuses* efforts to raise academic standards, the evaluation considers 
three supporting components of instructional rigor: ( 1 ) the extent to which STAR teachers use rigorous 
instructional strategies across all core content courses (Academic Rigor)* (2) the extent to which STAR 
teachers align instruction with campus and district colleagues (Curricular Alignment), and (3) the 
availability of rigorous course offerings for students in STAR schools (Advanced Academics). Exhibit 5.1 
highlights the Raising Academic Standards component of STAR implementation, its supporting 
components and indicators. These aspects of STAR implementation arc discussed in this chapter. 

Exhibit 5.1 
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DATA SOURCES: ACADEMIC STANDARDS 


The measurement of ST AR districts* efforts to improve academic standards relies on data collected 
through { 1 ) observations of instruction in a sample of core content area classrooms in STAR schools 
conducted in the spring of each evaluation year: (2) spring surveys of teachers on STAR campuses: (3) 
TEA Course Completion records: and (4) School Integrated Summary Reports: Advanced Placement 
Examination Performance and Participation Overview provided by the College Board. (See Appendix (i 
for detailed information on the measurement of each of the three supporting components of Raising 
Academic Standards as well as indicators of supporting components.) In addition, the chapter includes 
information collected through teacher focus groups and administrator interviews conducted during spring 
201 1 site visits. 

The sections that follow discuss the evaluation's approach to measuring each indicator and supporting 
component of the Raising Academic Standards component of STAR implementation. Results for the 
Academic Rigor and Curricular Alignment indicators arc presented for middle schools, high schools, and 
for all SPAR campuses: however, the Advanced Academics indicator is limited to S PAR high schools. 

For each indicator, results arc presented for 4 implementation years (i.c., 2007-08, 2008-09, 2009-10, and 
2010 - 11 ). 

MEASURING ACADEMIC RIGOR 

Improving the level of rigor in classroom instruction is central to achieving STAR'S goal of increasing 
students* readiness for postsecondary educational opportunities. Considerable research has established 
that access to rigorous instruction and challenging courecwork in high school is the strongest determinant 
of whether a student will be successful in postsecondary educational opportunities (Adelman. 1999. 2006; 
Levin. Belfield. Muennig. & Rouse. 2007; Rodcnck. Nagaoka. & Allensworth. 2006). In order to increase 
the level of rigor in instruction. SPAR offers a range of teacher professional development opportunities 
designed to improve instruction through the use of AP strategies. Such strategics include developing 
lessons that increase student engagement and participation, using questioning techniques that elicit 
higher-order thinking, developing quality assessments, and providing effective remediation. 

To facilitate increased academic ngor on STAR campuses. POC and College Board training consultants 
meet regularly with teachers to observe classroom instruction, offer feedback, model subject-specific AP 
instructional strategies, and provide support for curricular alignment. During classroom observations 
conducted in spring of each evaluation year, researchers measure the extent to which lessons include the 
higher-order thinking skills and AP subject-specific instructional strategics addressed in training, as well 
as the degree to which lessons engage students in the learning process. Researchers average scores across 
observed classrooms to find a mean score per indicator for each campus and convert scores to a 5-point 
scale, where scores indicate the extent to which each instructional component is implemented: not at all 
(0.00- 1 .25), to a small extent < 1 .26-2.50). to a moderate extent (2.5 1 -3.75). and to a targe extent (3.76- 
5.00). As noted in chapter 1, spring 201 1 classroom observations were limited to grade levels that served 
student cohorts included in STAR services— Grades 7 and 8 al the middle school level and Grades 9, 10. 
and 1 1 al ihc high school level. 
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Indicator Score: Higher Order Thinking Skills 


Figure 5. 1 illustrates the extent to which observed lessons included Higher Order Thinking Skills across 
the 2007-08, 2008-09, 2009-10. and 2010-1 1 school years. As indicated in the figure, researchers 
observed higher order thinking strategics somewhat less in 2010-1 1 than in 2009-10. In 2009-10, 
observed teachers used higher order thinking strategics to a small extent at both the middle school (2.46) 
and high school (2.3 1 ) levels. This represents a decrease from the 2009-10 school year, in which 
researchers observed higher order thinking strategics to a moderate extent (2.68 overall). 


Large extent 
(3.76-5.001 


Moderate extent 
(2.51-3.751 


Small extent 
(1.26-2.501 


Not at all 
(0.00- 1.25) 
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Figure 5.1. Average STAR scores for Higher Order Thinking Skills, as a mean by year: 2007-08 

through 2010 - 11 . 

Sources: STAR Classroom Observations, spring 2008. 2009. 2010. and 2011. 

Notes. Scores reported using a 5-point scale: not at all (0.00- 1 .25). a small extent < 1 .26-2.50). a moderate extent 
(2.5 1-3.75). and h large extent (3.76-5.00). Appendix G contains more information about each of the core 
components, supporting components, and indicators used in the measurement of STAR implementation. 


Indicator Scores: Subject-Specific Instructional Strategies 

Researches also recorded the extent to which teachers incorporated AP Subject-Specific Instructional 
Strategies for each of the four core content areas (i.c., Knglish language arts (ELA), math, social studies, 
and science) during classroom observations in the respective subject areas. Results for middle school 
classrooms arc presented in Figure 5.2a. results for high school classrooms arc presented in Figure 5.2b. 
and results aggregated across both sets of classrooms arc presented in F igure 5.2c. Findings for middle 
schools indicate that the use of Subject-Specific Instructional Strategies increased somewhat in ELA and 
social studies classrooms, but for math and science, the use of strategics decreased during the 2010-1 1 
school year. The use of subject -specific strategics decreased for all subject areas at the high school level 
in 2010-1 1, with the most notable decrease occurring in math. In the aggregate. ST AR classrooms 
incorporated AP strategics to a moderate extent in ELA and to a small extent in other subject areas during 
the 2010-1 1 school year (sec Figure 5.2c). 
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Figure 5.2a. Average middle sehool scores across campuses for Subject-Specific Instructional 
Strategies, as a mean by subject and year: 2007-08 through 2010-11. 

Sonnes: STAR Gassroom Observations, spring 2008. 2009. 2010. and 2011. 

Notes. Scores are reported using a 5 -point scale: not at all (0.00- 1 .25). <r small extent ( 1 .26-2.50). a moderate extent 
(2.5 1-3.75). and a /urge extent (3.76-5.00). Appendix G contains more information about each of the core 
components, supporting components, and indicators used in the measurement of STAR implementation. 



Figure 5.2b. Average high school scores across campuses for Subject-Specific Instructional 
Strategies, as a mean by subject and year: 2007-4)8 through 2010-1 1. 

Sonnes: STAR Classroom Observations, spring 2008. 2009. 2010. and 2011. 

Notes. Scores are repotted using a 5-point scale: not at all (0.00- 1 .25). a small extent ( 1 .26-2.50). a moderate extent 
(2.5 1-3.75). and u /urge extent (3.76-5.00). Appendix G contains more information about each of the core 
components, supporting components, and indicators used in the measurement of STAR implementation. 
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Figure 5.2c. Average STAR scores across campuses for Subject-Specific Instructional Strategies, as 
a mean by subject and year: 2007-08 through 2010-11. 

Sources: STAR Classroom Observations, spring 2008. 2009. 2010. and 2011. 

Notes. Scores arc repotted using a 5-point scale: nos at all (0.00- 1 .25). a small extern ( 1 .26-2.50). a moderate extent 
(2.5 1-3.75). and a large extent (3.76-5.00). For mote information regarding the construction of core components, 
supporting components, and indicators, the items used, and how scores w ere computed, see Appendix G. 

Indicator Score: Student Engagement 

During site visit classroom observations, researchers also recorded the average level of Student 
Engagement, using a 5-point scale, ranging from < 1 ) low engagement, to (3) moderate engagement, to (5) 
high engagement. Figure 5.3 presents results averaged across STAR middle schools and high schools, as 
well as the overall average for both types of schools for the 2007-08, 2008-09, 2009-10, and 2010-1 1 
school years. Relative to previous implementation years. STAR campuses earned somewhat higher 
Student Engagement scores (3.07 overall) in 2010-1 1. Both middle school (3.13) and high school (3.02) 
students exhibited moderate engagement dunng site visit classroom observations. 


35 









High 

Engagement 

<5.00) 


Moderate 

Engagement 

<3.00) 


Low 

Engagement 
< 1.<M>) 


Figure 5.3. Average STAR scores for Sludent Engagement. as a mean by year: 2007*08 through 
2010-11. 

Source* STAR Classroom Observations, spring 200K. 2009. 2010. and 2011. 

Notes. Scores are repotted using a 5-point scale: Ion engagement (1 .00). moderate engagement (3.00). and high 
engagement (5.00). Appendix G contains more information about each of the core components, supporting 
components, and indicators used in tire measurement of STAR impleiiKntation. 

Supporting Component Score: Academic Rigor 

Once scores for each rndicator of academic rigor were converted to the 5-pornt scale, a final score for the 
Academic Rigor supporting component was derived by averaging indicator scores for: ( 1 ) Higher Order 
Thinking Skills, (2) Subject-Specific Instructional Strategies . and (3) Student Engagement. As presented 
in Figure 5.4, STAR schools earned a mean Academic Rigor score of 2.39 (overall), or STAR schools 
partially implemented instructional rigor dunng the 2010-1 1 school year, which represents a slight 
decline relative to findings for 2009-10. 
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Figure 5.4. Supporting component wore: Academic Rigor, as a mean: 2CMI7-08 through 2010-11. 

Source*: STAR Classroom Observations, spring 2008. 2009. 2010. and 2011. 

.Notes. Scores are reported using a 5-point scale: not at till (0.00- 1 .25). a small extent ( 1 .26-2.50). a moderate extent 
(2.5 1 -3.75). and a /urge extent (3.76-5.00). Appendix G contains more information about each of the core 
components, supporting components, and indicators used in the measurement of STAR implementation- 


I ncreasing Academic Rigor: What About Homework? 

Across years, results from student surveys indicate that schools place limited academic demands on 
students outside ot regular instructional hours. The spring student survey contains an item that asks 
students to indicate the amount ol time they spend completing homework each day. Table 5.1 presents 
students' responses for the spring 2008. 2009. 2010. and 201 1 surveys. Across survey administration 
periods, the largest proportions ol both middle and high school students reported that they spend less 
than 30 minutes completing homework each day. Results tor 2010-1 1 indicate that the amount ol time 
both high school and middle school students spent completing homework decreased relative to 2009-10. 
Correspondingly the percentage ot students reporting that they did no homework increased in 2010-11. 

Table. 5.1. STAR Students' Average Amount ot Homework, as a Percentage: 2007-08 
Through 2010-11 


Amount 

Less than 30 
minutes 

30 to 59 minutes 
1 to 2 hours 
More than 2 
hours 


] Middle 

School* 1 

] High School" 

1 2007*08 1 

2008-09 

| 2009-10 

2010-11 

2007-00 

2008-09 

t 0 

2010-11 1 



11.2% 

16.3% 

NA 

Wt 

11.9% 

14.3% 1 



40.9% 

39.8% 

46.5% 

49.2% 

42.1% 

43.9% 



39.0% 

J j. jVo 


36.5% 

33.6% 

30.8% 



7.4% 



1 1 8% 

9.6% 




t.S% 

1 . 0 /o 

2 8% 

2.5% 

2.o .‘o 



source: 

“2007-08 (N-1.tMuj: ^Aio-uy (N- 

“2007-08 (N-3.371): 2008-09 (N-2.99 1 j; 2009-10 (N-3.075); 2010-1 1 tN-2.315) 
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MEASURING CURRICULAR ALIGNMENT 


STAR's goals (see Appendix F) address the importance of horizontal and vertical 1 team training in 
strengthening schools* academic programs, and in its role as a S PAR partner, the College Hoard offers 
training focused on promoting collaboration and cooperation between educators “from different grade 
levels in a given discipline... to develop and implement a vertically aligned program" (College Hoard. 
2004. p. 3). In addition. POC consultants provided individualized vertical team training and 
implementation support in each STAR district throughout the 2010-1 1 school year. Although vertical 
team training opportunities were open to both middle school and high school teachers in 2010 - 11 , 
trainings were generally offered at district high schools and were coordinated with high school schedules 
in order to ensure that large numbers of AP teachers would have access to sessions. Phis approach to 
providing training created barriers for some middle school teachers when sessions offered at high schools 
did not align with their schedules. Although some middle school teachers experienced challenges 
participating in vertical team training offered at high school campuses, middle school teachers generally 
were able to meet in campus-based vertical teams <i.e.. middle school teams) more frequently than their 
high school counterparts because the smaller size of middle schools provided greater flexibility in terms 
of scheduling meetings. 

As discussed in the sections that follow, the indicator scores Vertical Teaming Strategies and Vertical 
‘ Team Meetings arc derived from teachers* responses to sealed items included on spring surveys. Indicator 
scores are calculated by averaging sealed responses for individual teachers and then averaging across 
teachers at a particular campus to obtain a campus-level score. 

Indicator Score: Vertical Teaming Strategies 

In order to determine the extent to which core content area teachers on SPAR campuses implemented 
Vertical Teaming Strategies, the spring surveys asked teachers to indicate how often they used strategies 
such as working with peers to develop lesson plans, acting as an instructional coach or receiving 
coaching, observing a colleague's teaching or being observed by a colleague. Teachers responded using a 
5-point scale: ( 1 ) never , (2) rarely, (3) sometimes . (4) often, or (5) almost daily. Figure 5.5 presents 
aggregated survey results for S PAR middle school and high school teachers and the overall STAR 
average for 4 evaluation years. Results indicate that in 2010-1 1, STAR teachers sometimes used vertical 
teaming strategies (2.71 overall). Relative to results for 2009-10, teachers* reported use of vertical 
teaming strategies increased somewhat at middle schools and decreased somewhat at high schools. 


‘'Horizontal teams are made up of teachers of the same subject and grade level who work together to plan lessons 
and instructional strategies; vertical teams are made up of teachers of the same subject across grade levels who work 
to scaffold lesson plans and instructional strategies across grade levels. 
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Figure 5.5. Average STAR scores for Ihe Use of Vertical Teaming Strategies, as a mean by year: 
2007-08 through 2010-11. 

Sources: STAR Teacher. Counselor, and Librarian Survey, spring 2008. 2009. 2010. and 2011. 

Notes. Scores are reported using a 5-point scale: ( I ) never, (2 ) rarely. (3) sometimes . (4) often, or <5) almost daily. 
Appendix G contains more information about each of tlic core components, supporting components, and indicators 
used in the mcasuicmcnt of STAR implementation. 

Indicator Score: Vertical Team Meetings 

The evaluation's surveys also asked core content area teachers how often they participated in Vertical 
Team Meetings using a 5-point scale: ( I ) never, (2) one to two times a year, (3) one to two times a 
semester. (4) at least once a month, or (5) at least once a week. Figure 5.6 presents aggregate scores 
averaged across STAR middle schools and high schools, as well as the overall average for teachers on all 
ST AR campuses. Results indicate that teachers in both middle and high schools met one to two times a 
year (2.48 overall) in 2010-1 1. Middle school teachers' pailicipation in meetings increased somewhat, 
while high school teachers' participation decreased slightly. 
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Figure 5.6. Average STAR scores for the Frequency of Vertical Team Meetings, as a mean by year: 
2007-08 through 2010-11. 

Sources,: STAR Teacher. Counselor, and Librarian Survey, spring 200X. 2009. 2010. and 2011. 

Notes. Scores are reported using a S-point scale: < I ) never , (2) one to /no tones a year . (3) one to rn » times a 
semester . (4) at least once a month, or (5) at least once a ‘seek. Appendix Ci contains more information about eacli of 
the core components, supporting components, and indicators used in the measurement of STAR implementation. 
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Challenges to I mpfementing Vertical Teams 


Core content area teachers responding to surveys indicated the extent to which various challenges 
presented barriers to vertical teaming. Results are presented as summed percentages. Summed 
percentages present the percentage ol teachers who indicated a barrier represented a moderate 
challenge plus the percentage of teachers indicating a barrier was a large challenge. Table 5.2 
presents results lor surveys administered in spring 2008. 2009. 2010. and 201 1. Across survey 
administrations, teachers cited time and scheduling constraints as the primary barrier to meeting in 
vertical teams. Roughly similar proportions of teachers identified inadequate leadership, staff turnover, 
poor communication, insufficient teacher preparation as barriers across yeas. 


Table 5.2. Barriers to Vertical Teaming, as a Summed Percentage of Respondents: 2007-08 
Through 2010-11 


Challenge (i 

2007-08 

(N=336) 

2008-09 

<N=312) 

2009-10 

(N=298) 

2010-11 

(N=307) 

Time scheduling constraints 

£o% 

00.9 .'o 


79.9% 

80.1% 

Inadequate leadership or guidance 

41. t% 

38.9% 

43.0% 

Poor communication between 

teachers 

Turnover 

34.1% 

43.5% 

37.2% 

39.7% 

41.0% 

42.7% 

38.3% 

38.4% 

Vertical teaming is not a priority 

NA 

32.7% 

30.6% 

37. t% 

Insufficient teacher participation 

32.7% 

38.1% 

35.3% 

36.2% 


AR Teacher. Counselor, and Libranan Survey, spring 2008. 2009. 2010. and 2011. 

x>t ap**.cable. This survey item was 'niroduced in spring 2009. Summed percentages consist ol 


the percentage of respondents indicating a challenge was a barrier to a moderate extent plus the percentage 
of respondents indicating a challenge was a barrier to a large extent. 

Consistent with findings reported in Table 5.2. participants in site visit interviews and focus group 
discussions reported that district scheduling conflicts, lack of leadership, and weak communication 
limited teachers' ability to participate in vertical teams. In interviews conducted in spring 201 1 . many 
teachers said that they were unable to meet in vertical teams because district policies limited the 
amount of time teachers spent working outside ol the classroom. Such policies were generally 
implemented in response to poor TAKS scores and concerns about accountability ratings. As one 
administrator noted, time spent working outside of class is 'taboo now.* 

Some administrators and teachers also noted that vertical teams were not considered a priority 
because their districts used a curriculum package |i.e.. CSCOPE) that aligned core content area 
instruction across grade levels. 


Supporting Component Score: Curricular Alignment 

Campuses* Vertical Team Strategies and Vertical Team Meeting indicator scores were averaged to obtain 
a Curricular Alignment supporting component score for each STAR campus (sec Exhibit 5.1). Figure 5.7 
presents results averaged across STAR middle schools, high schools, and all STAR campuses (STAR 
Average). Results indicate, on average, campuses /wrtially implemented strategics to align curricula (2.60 
overall). Middle school scores (2.66) increased slightly from 2009-10 while high school scores (2.56) 
remained about the same. 
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Figure 5.7. Supporting component score: Curricular Alignment, as a mean by year: 2007-08 
through 2010 - 11 . 

Sonnes: STAR Teacher. Counselor, and Librarian Survey, spring 2008. 2009. 2010. and 2011. 

Notes. Scores are repotted using a 5-point scale. Mean Curricular Alignment: minimal (0.00 - 1 .50 ). partial 1. 1 .5 1 
3.00). substantial (3.01 4.50). and full (4.51 - 5.00). Appendix G contains mote information about each of the core 
components, supporting components, and indicators used in the measurement of STAR implementation. 


The Benefits of Working in Vertical Teams 

Although teachers participating in spring 201 1 focus groups generally agreed that the emphasis on 
vertical teams had diminished across STAR implementation years, teachers also highlighted the benefits 
of working in vertical teams that included both the middle school and high school faculty. As one middle 
school science teacher explained: 

For me. it [vertical teaming) helps because I’ve just moved to eighth grade... The seventh grade 
teacher discusses with me the things that she's covered. Plus, all the TEKS have been moved 
around in science. Sometimes I can go to the [high school) biology or chemistry teacher and have 
a discussion about what I need to do to prepare them [students] beyond my TEKS. 



Teachers also pointed to the need to include elementary schools in vertical teams in order to more 
effectively prepare students for postsecondary opportunities. A high school teacher said: 

[Vertical alignment) really should be fifth through twelfth [rather than seventh through twelfth). We 
really need to look all the way from fifth grade through twelfth grade. It’s like we need to sit down 
with those teachers and say: 'I don’t care what CSCOPE says. I don’t care what the TAKS 
objectives or TEKS objectives are. We need to look at how we can get our kids better prepared 
for high school because in high school we re trying to get them prepared for college. 

In recognition ol the benefits of vertical teaming, teachers in one district said they planned to be more 
assertive about requesting that in-service training days be used to support vertical teams in the future. 
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MEASURING ADVANCED ACADEMICS (HIGH SCHOOL ONLY) 


STAR also seeks to raise academic standards by increasing the percentage of students enrolling in and 
successfully completing advanced courses. As presented in Exhibit 5.1, this supporting component, 
known as Advanced Academics is limited to STAR high schools, is made up of three indicators: (1) 
Advanced Course Completion . (2) AP Exam Participation , and (3) AP Exam Indicators. The Advanced 
Course Completion indicator measures the percentage of high school students who participate in 
advanced courses such as AP or dual credit courses in a given year. The AP Exam Participation indicator 
measures the percentage of high school students who participate in AP testing in a given year, and the AP 
Exam St ore indicator measure the percentage of tested students who receive a score of 3 or higher on AP 
exams in a given year. 6 At the tunc of this report’s writing, the TEA data used to construct the Advanced 
Course Completion indicator were available through the 2009-10 school year: however, the data used to 
construct the AP Exam Participation and AP Exam Indicator scores were available through 2010-11. The 
results presented in the sections that follow reflect the diftcrcnccs in available data. 

Indicator Score: Advanced Course Completion 

Advanced Course Completion scores represent the percentage of students at S PAR high schools who 
received credit for at least one advanced course in a given school year. STAR establishes the goal of 50% 
of students completing AP or concurrent enrollment courses (see Appendix F) and the Advanced Course 
Completion indicator is measured relative to this goal using a 5-point scale: ( 1 ) 10% of students complete 
advanced courses (achieving 20% of the STAR goal): (2) 20% of students complete advanced courses 
(achieving 40% of the STAR goal). (3) 30% of students complete advanced courses (achieving 60% of 
the STAR goal). (4) 40% of students complete advanced courses (achieving 80% of the STAR goal), and 
(5) 50% of students complete advanced courses, (achieving 100% of the STAR goal). As noted in the 
previous section. TEA advanced course completion data arc lagged a year. Therefore, data for STAR 
implementation Year 5 (i.c.. 2010-11) rely on course completion data for the 2009-10 school year. 

Figure 5.8 presents results for STAR high schools and indicates that advanced course completions 
increased when the lead STAR cohort (seventh grades in 2006-07) entered high school in 2008-09 and the 
pattern of increase continued in 2009-10, when cohort students were in the tenth grade. Although results 
presented in Figure 5.8. fall short of STAR goals, the trend suggests increasing numbers of students in 
STAR high schools arc participating in advanced courscwork. Recognizing that most AP and dual credit 
courses arc taken when students arc in the eleventh and twelfth grades, this trend is expected to increase 
more steeply as the STAR cohort progresses through the final years of high school. 


1 ’Although policies vary, most colleges and university award credit tor scones of 3 or higher on AP exams. 
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Figure 5.8. Average STAR scores for Advanced Course Completion, as a mean by year: 
Implementation Year 2 through Year 5. 

Sources. TEA Course Completion Records. 2000-07. 2007-08. 2008-09. and 2009-10. 

Notes. Data are lagged a year. Results for STAR implementation Year 5 (i.e.. 2010-1 1) rely on 2009- 10 data. Scores 
ate reported using a 5-point scale < I ) 10% of students enrolled in advanced courses, or 20% of STAR goal: (2) 20% 
of students enrolled, or 40% of STAR goal. <3)30% of students enrolled, or 60% of STAR goal: (4) 40% of students 
enrolled, or 80% of STAR goal; and (5) 50% of students enrolled in advanced courses, or 100% of STAR goal. 
Appendix G contains more information about each of the core compownts. supporting components, and indicators 
used in the measurement of STAR implementation. 

Indicator Scores: AP Exam Participation and AP Exam Score 

Similarly. AP Exam Participation indicator scores arc reported using a 5-point scale derived relative to 
the statewide average for students* participation in AP exams for a given school year. In 2010-1 1 the 
statewide average for high school students' completion of AP exams was 13.9%. This defines the 
following scale: ( 1 ) 2.8% of students took an AP exam (20% of state average). (2) 5.6% of students took 
an AP exam (40% of state average). (3) 8.3% of students took an AP exam (60% of state average). (4) 

1 1 . 1 % of students took an AP exam (80% of state average), and (5) 13.9% of students took an AP exam 
(100% of state average). The scale for the AP Exam Score indicator is derived using an analogous 
process. The scale measures the percentage of AP exams taken by students at STAR high schools that 
received a score of 3 relative to the cotrcsponding state average of 43.9%. This process defines the 
following scale: ( 1 ) 8.8% of tests scored 3 or higher (20% the state average). (2) 17.6% of tests scored 3 
or higher <40% of the state average). (3) 26.3% of tests scored 3 or higher (60% of the state average X (4) 
35.2% of tests scored 3 or higher < 80% of the state average), and (5) 43.9% of tests scored 3 or higher 
( 100 % of the state average). 

As presented in Figure 5.9. STAR high schools increased AP Exam Participation substantially in 2009-10 
when 16.4% of students attending STAR high schools participated in AP exams relative to the state 
average of 12.8%. Given that measures of implementation are framed in terms of a 5-point scale, results 


i.i 











for STAR high schools arc capped at a score of 5, although STAR high schools achieved 1 29% of the 
state average in 2009-10. Similarly, results for 2010-1 1 indicate that STAR high schools continued to 
exceed the state average. In 2010-1 1, 13.9% of students statewide took at least one AP exam compared 
with 18.9% of students at STAR high schools (135% of the state average). 

Although ST AR high schools have increased the proportion of students participating in AP exams, results 
presented in Figure 5.9 suggest that smaller percentages of tested students arc earning a score of 3 or 
better. In 2010-1 1. only 5% of AP test takers at STAR high schools earned a score of 3 or better 
compared with about 44% of test takers statewide. The decline in the percentage of students earning 
scores of 3 or better in STAR high schools suggests that while high schools arc successful in encouraging 
students to participate in testing, many tested students lack the academic preparation to cam scores that 
will receive college credit. 
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Figure 5.9. Average STAR high school scores for AF Exam Participation and AP Exam Indicators, 
as a mean by year: 2007-08 through 2010-11. 

Sources: College Board School Integrated Summary Reports Adv anced Placement Examination Performance and 
Participation Overview and Texas Education Agency Academic Excellence Indicators System enrollment data. 
2007-08. 2008-09. 2009-10. and 2010-11. 

Notes. Scores are repotted using a 5 -point scale framed in terms of STAR high schools performance relative to state 
averages: (I ) STAR high schools achieve 20% of state average.! 2) STAR high schools achieve 40% of state average; 
(3) STAR high schools achieve 60% of state average; (4) STAR high schools achieve 80% of state average; and (5) 
STAR high schools achieve 100% of state average. Appendix G contains more information about each of the core 
components, supporting components, and indicators used in the measurement of STAR implementation- 
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Supporting Component Score: Advanced Academics (High School Only) 


Researcher* averaged scores across the ( I ) Advanced Course Completion* (2) AP Exam Participation* and 
0)AP Exam Score indicators to obtain an aggregate Advanced Academics supporting component score 
for STAR high schools. Although results presented in Figure 5.10 indicate that STAR high schools 
implemented Advanced Academics at a partial level in 2010-1 1, the increasing trend across grant years 
suggests that high schools are making consistent progress in improving students* access to and 
participation in ngorous courscwork. 
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Figure 5.10. Supporting component score: Advanced Academics, as a mean hv year: 2007-08 
through 2010 - 11 . 

Sources. TEA Course Completion Records. 2000-07.2007-08. 2008-09. 2009-10; College Board School Integrated 
Summary Repoits: Advanced Placement Examination Performance and Partieipation Overview and Texas 
Education Agency Academic Excellence locators System enrollment data: 2007-08. 2008-09. 2009-10. and 
2010-11. 

Notes. Scores arc rcpoited using the following scale, minimal implementation (0.00-1 .5). partial implementation 
(1.51-3.00). substantial implementation (3.01-4.50). and full implementation (4.51-5.00). Appendix G contains more 
information about each of the core components, supporting components, and indicatots used in the measurement of 
STAR implementation. 

CORE COMPONENT SCORE: RAISING ACADEMIC STANDARDS 

Researches averaged the ( 1 ) Academic Rigor. (2) Curricular Alignment, and (3) Advanc ed Academics 
supporting component scores to obtain an overall Raising Academic Standards core component score for 
each campus (see Exhibit 5.1). Because Advanced Academics data arc limited to high schools, averages 
for middle school implementation are limited to results for the Academic Rigor and Curricular .Alignment 
supporting components. As presented in Figure 5.1 1, STAR schools earned a 2.50 (overall), or STAR 
schools partially implemented instructional and curricular strategics designed to raise academic standards 
in 2010-1 1 . Middle schools earned a somewhat higher mean score (2.55) than high schools (2.48), 
although results indicate partial implementation at both levels. 
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Figure 5.1 1. Core component scores: Raising Academic Standards, as a mean by year: 2007-08 
through 2010 - 11 . 

Sources: STAR Classroom Observations, spring 2008. 2009. 2010. and 201 1 ; STAR Teacher. Counselor, and 
Librarian Survey. 2008. 2009. 2010. and 201 1: TEA Course Completion Records. 2006-07. 2007-08. 2008-09. and 
2009-10: College Board School Integrated Summary Reports. Advanced Placement Examination Performance and 
Participation Overview and TEA Academic Excellence Indicator* System enrollment data. 2007-08. 2008-09. 2009- 
JO. and 2010-11. 

Notes. Middle School averages are limited to Academic Rigor and Curricular Alignment supporting components. 
Scores are reported using a 5-point scale: minimal (0.00 - 1.50). partial (1.5 1 - 3.00). substantial (3.01 4.50). and 
full (4.5 1 - 5.00). Appendix G contains more information about each of the core components, supporting 
components, and indicators used in the measurement of STAR implementation. 

SUMMARY 

(>n average. STAR schools partially implemented activities and services designed to raise academic 
standards, although findings indicate increasing trends in the level of student engagement in STAR 
classrooms and the proportion of high school students participating in advanced coursework and AP 
testing. Indicators for advanced course completion and AP testing are expected to increase further as the 
lead STAR cohort (seventh grader* in 2006-07) enter their final year* of high school because many 
advanced courses arc limited to students in the eleventh and twelfth grades. Although STAR high schools 
have made substantial gams in the proportion of students participating in advanced coutsework and AP 
testing, they have not experienced a corresponding increase in the proportion of students who achieve AP 
test scores sufficient to earn college credit. This suggests that high schools must continue to focus on 
rigorous classroom instruction in order ensure that students have the academic preparation needed for 
postsccondary opportunities. 

The need for increased academic rigor is also evident in results for the Higher Order Thinking Skills and 
Subject-Specific Instructional Strategies indicators at both the middle school and high school levels. 
During classroom observations conducted in spring 201 1, researchers observed teachers using questioning 
strategics that required students to use higher order thinking to a lesser extent than in spring 2010. In 
addition, researcher* observed fewer subject-specific instructional strategics across the four core content 
areas at the high school level and in math and science at the middle school level. 
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Results presented in this chapter indicate that despite challenges to participating vertical team training, 
middle school teachers met in vertical teams and used vertical teaming strategies more often than high 
school teachers. It is likely that the smaller size of middle schools facilitates the easier coordination of 
vertical team meetings and may partially explain this finding. However, in focus group interviews, both 
high school and middle school teachers highlighted the benefits of working in vertical teams, noting that 
the meetings provided opportunities to align instruction and discuss students' needs. 
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Chapter 6 

Engaging Teachers and Students 


A second component of STAR implementation is the degree to which teachers and students arc engaged 
in achieving program goals. As discussed in chapter 4, the evaluation measures this component of STAR 
implementation by considering ( 1 ) teacher engagement in STAR professional development opportunities 
and (2) student participation in activities that address STAR goals and attendance rates. This chapter 
presents findings from the evaluation's analysis of STAR campuses' progress in engaging teachers and 
students in activities that support STAR. Exhibit 6.1 illustrates the structure of this analysis and its place 
within the larger context of STAR implementation. 


Exhibit 6.1 


Impicmcntutico 



DATA SOURCES: TEACHER AND STUDENT ENGAGEMENT 

The measurement of teacher and student engagement relies on data collected through spring surveys of 
( 1 ) teachers and (2) students on STAR campuses, as well as (3) campus attendance rates reported in 
REIMS. The chapter also includes information about districts* approaches to engaging teachers and 
students that was collected during site visit interviews conducted in spring 2011. The sections that follow 
discuss the evaluation's approach to measuring teacher and student engagement and provide measures of 
the degree to which tcachcre participated in professional development and students were engaged in 
school during the 2010-1 1 school year. Results arc presented for middle schools, high schools, and all 
STAR campuses (STAR Average) across 4 implementation years (i.c., 2007-08, 2008-09, 2009-10, and 
2010-1 1). Appendix (i presents detailed information about how each supporting component and indicator 
of teacher and student arc constructed. 

MEASURING TEACHERS ENGAGEMENT IN PROFESSIONAL DEVELOPMENT 

As a means to engage teachers in STAR implementation and to increase academic outcomes for students. 
STAR provides a range of professional development activities for teachers across each implementation 
year. Training activities are facilitated by POC and College Board representatives and generally arc 






focused on improving classroom instruction. Prior to the 2009-10 school year, most professional 
development opportunities were offered in a workshop format in which teachers across districts came 
together to receive training in a common location. However, low rates of participation across the 2006-07 
through 2008-09 school years, led grant managers to revise the approach to providing training during the 

2009- 10 school year. Instead of holding large-scale trainings offered to teachers in a single location. POC 
and College Hoard consultants visited STAR districts and campuses in order to provide campus-based 
professional development. This approach was sustained during the 2010-1 1 school year. 

In order to measure teachers' engagement in professional development, the spring surveys asked 
respondents to indicate whether they had received sufficient training to implement AP strategics, use data 
to plan instruction, and whether their schools encouraged them Icam and implement new instructional 
strategics. Teachers indicated their level of agreement using a 5-point scale: (I) strongly disagree, (2) 
disagree , (3) unsure . (4) agree . or (5) strongly agree . (See Appendix G for specific survey items.) 
Responses were averaged for individual teachers and then across teachers to compute a mean Teachers 9 
Attitudes Toward Professional Development score for each STAR campus. 

As indicated in Figure 6.1, teachers tended to agree (3.60 overall) that they received sufficient training in 

2010- 11 and that their campus supported professional development opportunities. High school teachers 
reported lower levels of agreement in 2010-1 1 than they expressed in previous years (3.52). The 
responses of middle school teachers have remained largely unchanged across evaluation years. 

Strongly Agree 
<5.00> 

Agree 
<4.00) 

Unsure 
<3.00) 

Disagree 
< 2 . 00 ) 

Strongly Disagree 

<i.oo> 


Figure 6.1. Average scores for Teachers* Kngagement in Professional Development, as a mean by 
year: 2007-08 through 2010-11. 

Sources: STAR Teacher. Counselor, and Librarian Survey, spring 2008. 2009. 2010. and 2011. 

Notes. Scores aic repotted using a 5 -point scale: (l ) strongly disagree , (2) disagree . (3) unsure, (4) agree . or (5) 
strongly agree. Appendix G contains more information about each of the core components, supporting components, 
and indicators used in the measurement of STAR implementation. 
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MEASURING STUDENT ENGAGEMENT IN SCHOOLING 


STAR also seeks to increase students* engagement in schooling by increasing the number of activities 
designed to heighten students* focus on academic achievement and career opportunities. STAR partner 
organizations, such as FACE and the Faculty Fellows Program, work with districts to design and 
implement activities that encourage students to be more involved in school and to take ownership of their 
academic outcomes. In measuring the Student Engagement in Schooling supporting component of STAR 
implementation, the evaluation considers two indicators: ( I ) Student Participation in STAR Support 
Activities and (2) Student Attendance Rates. The sections that follow discuss results for each of these 
indicators, as well as the Student Engagement in Schooling supporting component score. 

Indicator Score: Student Participation in STAR Support Activities 

'Ihc measurement of STAR implementation incorporates an indicator of students* participation in 
activities designed to achieve STAR*s goals and objectives. 1 Across spring survey administrations 
middle and high school students responded to items that asked whether they participated in a range of 
STAR support activities, including tutoring, counseling, and mentoring, as well as STAR partner- 
sponsored events. Researchers used survey responses to identify the number of unique activities in which 
students participated during a given school year. Figure 6.2 presents findings using the following 5-point 
scale: ( 1 ) I.S types of activities* (2) 3.0 types of ac tivities* ( 3)4.5 types of activities. (4) 6.0 types of 
activities . or (5) 7.5 types of activities. Results indicate that high school students* participation in STAR 
activities has consistently increased across implementation years, marked by a notable increase m 
participation levels after the lead STAR cohort moved to high school in 2008-09. Participation in STAR 
activities has fluctuated at the middle school level, with higher levels of participation in 2007-08 and 
2009-10, but lower levels during the 2008-09 and 2010-1 1 school years. 


A detailed overv iew of STAR'S goals and objectives is presented in Appendix F. 
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Figure 6.2. Average STAR scores for Student Participation in STAR Support Activities, as a mean 
by year: 2007-08 through 2010-1 1. 

Sonnes: STAR Middle School and High School Student Surveys, spring 200!'. 2009. 2010. and 201 1. 

Notes. Scores are repotted using a S-point scale: <1 ) 1.4 types of activities. (2) 2.S types of activities . (3) 4.2 ty/ies of 
activities. (4) 5.0 types of activities . or (5) 7.0 types of activities. Appendix G contains more information about eaeli 
of the core components, suppoiting components, and indicators used in the measurement of STAR implementation. 

Indicator Score: Student Attendance Rates 

Recognizing that any educational intervention intended to affect student outcomes will have a limited 
impact if students arc not present in school to receive serv ices, the measurement of STAR implementation 
includes an indicator of student attendance. Student Attendance Kate scores arc measured using data 
obtained from TEA's PEIMS archival database. Because REIMS attendance data arc lagged a year, scores 
for each implementation year arc derived using data from the previous school year — the most current data 
available for a given school year. For example, the 2007-08 Student Attendance Kate score relics on 2006- 
07 PEIMS data and 2008-09 scores rely on 2007-08 data. Because of this limitation, the evaluation 
includes lagged Student Attendance Kate scores as a proxy for current year outcomes. Student Attendance 
Kate scores arc reported using a 5-point scale based on STAR schools' attendance rates relative to the 
slate average for a given year (95.5% in 2009-10): { 1 ) a 76.4% attendance rate or 80% of the state 
average. (2) an 81.2 % attendance rate or 85% of the state average, (3) an 86.0% student attendance rate 
or 90% of the state average, (4) a 90. 7% student attendance rate or 95% of the state average, or (5) a 
95.5% student attendance rate or 100 % of the state average. 

As presented in Figure 6.3, STAR middle schools and high schools maintained a 92% average attendance 
rate, representing 96% of the state average in 2010-1 1 (data drawn from 2009-10). Middle school and 
high school students had similar attendance rates ( about 92%). which was about 96% of the state av erage. 
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Figure 6.3. Average STAR scores for Student Attendance Rates, as a mean by year: 2007-08 
through 2010-11. 

Sources: Public Education Indicator Management System (PEIMS): 2006-07. 2007-08. 2008-09. and 2009-10 
atteiMlance data. 

Notes. Scores are repotted using a 5-point scale: (I ) a 76.4% attendance rate or 80% of the Mate average. (2 > an 
81.2 % attendance rale or 85% of the Hale average. (3) an 86.0% student attendance rate or 90% of the state 
average. (4) a 90.7% Undent attendance rule or 95% of the stale average, or (5) a 95.5% student attendance rale or 
100% of the slate average. Appendix G contains more information about each of the core components, supporting 
components, and indicators used in tire measurement of STAR implementation. 

*Seore is a proxy drawn from 2006-07 PEIMS data. 

"Score is a proxy drawn from 2007-08 PEIMS data. 

‘Score is a proxy drawn from 2008-09 PEIMS data. 

‘‘Score is a proxy drawn from 2009-10 PF.IMS data. 

Supporting Component Score: Student Engagement in Schooling 

As noted earlier in this section, the supporting component score for Student Engagement in Schooling is 
the average of schools* scores for Systems' of Support and Student Attendance Kates ( sec Exhibit 6. 1 ). 
Results presented in Figure 6.4 indicate that both middle schools (3.09) and high schools (3.28) achieved 
substantial levels of student engagement during the 2010-11 school year. However, trends across years 
indicate that middle school student engagement scores dropped in 2010-1 1. which may reflect a reduced 
emphasis on STAR since the lead cohort moved to high school. 
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Figure 6.4. Supporting component scores: Student Kngagement in Schooling, as a mean by year: 
2007-08 through 2010-11. 

Sources: STAR Middle School and High School Student Surveys. spring 2008. 2009. 2010. and 201 1. Public 
Education Indicator Management System (PEIMS): 2006-07. 2007-08. 2008-09. and 2009-10 attendance data. 
Notes. Scores are repotted using a 5-point scale: minimal (0.00 - 1 .50). initial ( 1 .5 1 - 3.00), substantial (3.01 - 
4.50). and full (4.51 - 5.00) levels of engagement. Appendix <i contains more information about each of the core 
components, supporting components, and indicators used in the measurement of STAR implementation. 

CORE COMPONENT SCORE: ENGAGING TEACHERS AND STUDENTS 

Researches averaged ( 1 ) Teachers' Engagement in Professional Development and (2) Student 
Engagement in Schooling supporting component scores to obtain the composite Engaging Teachers and 
Students core component score. Results presented in Figure 6.5. indicate that STAR campuses earned an 
average Engaging Teachers and Students core component score of 3.40 overall, which indicates 
substantial implementation. Average results were similar for STAR high schools (3.40) and middle 
schools (3.41); however, the pattern of decline evident in scores for both levels of schooling supports 
teachers' views that implementation efforts arc diminishing as the grant enters its final years. 
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Figure 6.5. (.ore component scores: Engaging Teachers and Students, as a mean by year: 2007-08 
through 2010 - 11 . 

Swines: STAR Teacher. Counselor, and Librarian Survey, spring 2008. 2009. 2010. and 2011: STAR Middle 
School and High School Student Surveys, spring 2008. 2009. 2010. and 201 1. Public Education Indicator 
Management System (PE1MS): 2006-07. 2007-08. 2008-09 and 2009-10 attendance data. 

Notes. Results are reported using a 5-point scale: minimal (0.00 1 .501. partial (1.51- 3.00). substantial (3.01 - 
4.50), and full (4.51 - 5.00) levels of engaging teachers and students. Appendix G contains more information about 
each of the core components, supporting components, and indicators used in the measurement of STAR 
implementation. 

SUMMARY 

Results presented in this chapter indicate that STAR districts have engaged teachers and students to a 
substantial extent across grant years, but that the focus on STAR implementation may be diminishing as 
the grant enters its final years. In alignment with decreasing scores for the core component Engaging 
Teachers and Students in 2010-11. teachers said that there was less of a focus on professional 
development and partner representatives noted that it was more difficult to implement their programs and 
activities than in previous grant years. 

Despite the reduced emphasis on STAR implementation, results for high school students reflect a pattern 
of increasing participation in activities, such as tutonng and counseling, that arc focused on achieving 
STAR goals and the increasing trend begins in 2008-09 when the lead STAR cohort entered high school. 
In contrast, middle school students* participation in activities that support STAR has fluctuated across 
years, with the lowest level of participation occurring in 2010-1 1. This pattern suggests that 
implementation efforts may be more focused on the lead STAR cohort and that middle school services 
may decline as the cohort progresses through high school. 
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Chapter 7 

Increasing Student and Parent Access to Information 


In order to increase academic achievement and develop college-going cultures among low-income 
students and their families, STAR provides increased access to informational resources about 
postsccondary educational opportunities. STAR information resources arc designed to improve parents* 
and students' ability to plan and prepare for long-term educational goals. .As presented in Exhibit 7.1, the 
evaluation measures this component of STAR — Increasing Student and Parent Access to Information — 
by examining two supporting components: STAR campuses' implementation of services that provide 
informational resources to ( I ) students (Student Access to Information ) and (2) parents (Parent Access to 
Information ). More information about how core components, supporting components, and indicators arc 
constructed is included in Appendix G. 


Exhibit 7.1 
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I ik reusing Student und 
Parent Access to Information 


Student Access to Informuti 


Informational Activities 


Students* Fartkipatkm in 
Summer Program* 


Students* Awareness of 
Pnsticcondort Opportunities 


Students* Awareness of 
Kntraixe Requirements 


Students* Awareness of 
Financial Assistance 



Parent Accent to Information 


Parent Acres* to Partial 
Information 


Purent Acres* to Full 
Information 


Parent Awareness of 
GEAR UP/STAR 




DATA SOURCES: STUDENT AND PARENT ACCESS TO INFORMATION 

'Ihc evaluation's measurement of students* and parents' access to postsccondary planning information 
relics on data collected through ( 1 ( spring surv eys of students in STAR schools, (2) student summer 
program participation data from the POC, and (3) spring surveys of STAR parents. In addition, the 
discussion includes information collected during spring 201 1 interviews with administrators and 
counselors, as well as focus group discussions with teachers on STAR campuses. 

Ihc sections that follow discuss the evaluation's approach to measuring student and parent access to 
postsccondary planning information and provide measures of the degree to which STAR schools provided 
information to students and parents during the 2010-1 1 school year. Results arc presented for middle 
schools, high schools, and all STAR campuses across 4 implementation years (i.c., 2007-08, 2008-09, 
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2009-10, and 2010-11). See Appendix (i for more information on the measurement of the student and 
parent supporting components. 

MEASURING STUDENT ACCESS TO INFORMATION 

'Ihc STAR goals (see Appendix F) emphasize the importance of providing all students with 
comprehensive information about postsecondary opportunities, including entrance requirements and 
financial aid (TEA, 2006). The Student Access to Information supporting component of STAR 
implementation is derived from the average of five indicators: ( I ) Student Informational Activities . (2) 
Students' Participation in Summer Programs . (3) Students' Awareness of Postsecondary Opportunities . 
(4) Students' Awareness of College Entrance Requirements . and (5) Students ' Awareness of Financial 
Assistance (sec Exhibit 7.1). The indicators arc designed to measure the extent to which STAR schools 
implement activities and services that support students* awareness of postsecondary opportunities and 
planning needs. The sections that follow discuss the evaluation's approach to measuring each indicator as 
well as the Student Access to Information supporting component score. 

Indicator Score: Student Informational Activities 

Ihc Student Informational Activities indicator measures the degree to which STAR campuses prov ide 
students with access to activities designed to support college access and planning, such as college tours, 
college or career fairs, presentations by college faculty, and so on. The spring student surveys ask 
respondents to indicate the activities they participated in during a given school year from a list of typical 
STAR informational activities (c.g., college fairs, college planning workshops, college tours). 'Ihc 
evaluation considers the average number of unique activities students attended on each campus, 1 K and 
averages are presented according to the 5-point scale: students attended (1)7 kind of activity y (2)2 kinds 
of activities . (3) 3 kinds of activities . (4) 4 kinds of activities* and (5) 5 kinds of activities. Because items 
addressing access to informational activities were not included on the spring 2008 survey, scores for the 
2007-08 school year are not included in the analysis. 

Findings presented in Figure 7.1 indicate that in 2010-1 1 students in STAR schools participated in fewer 
activities than in 2009-10. On average, students in STAR schools participated in less than two (1.44) 
unique types of activities. While high school students participated in more activities than middle school 
students ( 1 .94 vs. 1 .34), scores declined across both sets of students in 2010-1 1 . 


,: *The item measured the number of unique kinds of activities. For example, students may have participated in 
several campus touis but this w ould be measured as one kind of activity. 


58 




5.00 

5 Types 
(5.00 > 

4.50 

4 Types 

4.00 

<4.00 > 

3.50 

3 Types 

3.00 

<3.00 > 

2.50 

2 Types 

2.00 

<2.00 > 

1.50 

1 Type 

1.00 

<1-00* 

0.50 


0.00 


1.43 1-52 IJ4 



STAR Middle Schools 



STAR High Schools 



STAR Average 


■ 2007-08 12008-09 12009-10 12010-11 


Figure 7.1. Average STAR scores for Informational Activities, as a mean by year: 2007-08 through 

2010 - 11 . 

Sources: STAR Middle School and High School Student Surveys, spring 2009. 2010. and 201 1. 

Notes. Data is not available for 2007-08 (NA) because survey items were added in 2008-09. Responses are reported 
using a 5-point scale: students attended (1) / kind of activity. (2) 2 kinds of acih'ities. (3) 3 kinds of activities, (4) 4 
kinds of activities* and (5) 5 kinds of activities. Appendix G contains more information about each of the core 
components, supporting components, and indicators used in the measurement of STAR implementation. 

Indicator Score: Students’ Participation in Summer Programs 

In addition to activities provided during the school year. TEA and the POC offer STAR summer programs 
focused on increasing college awareness. TEA program administrators established the expectation that 
cohort students from each STAR district will participate in summer programs each year of the grant, and 
the POC’ offers an optional Summer Bridge program with space for 30 students from each STAR distnet. 
The Students’ Participation in Summer Programs indicator score relics on POC attendance data for 
STAR summer programs at TAMU-CC and considers the percentage of students per district attending 
summer programs relative to available space (30 students per district), fhc POC first provided 
programming in the summer of 2009. so scores do not exist for the 2007-08 implementation year. Scores 
arc presented using a 5-point scale: (1)6 students attended or 20 % oj available space . (2) 12 students 
attended or 40 % of available space. (3) 18 students attended or 60 % of available space. (4) 24 students 
attended or 80% of available space, and (5) 30 students attended or 10) % of available space. 

As presented in Figure 7.2, districts sent seven students, on average, to POC summer programs, or met 
23% of available space in summer 201 1 (2010-1 1 implementation year). This marks a decline from the 
previous years in which districts sent 16 students to summer programs, on average. Participation in the 
summer bridge program was low across districts on 201 1 — the district with the most participants sent 
only 12 students and one district did not have any students who participated in the program. However, 








some districts offered local summer programs to meet the goal of engaging cohort students in summer 
programs. 


STAR Average 


100 % of 

STAR Goal 
(5.00) 


60 % of 
STAR Goal 
<3.00) 


20 % of 
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( 1 . 00 ) 



Figure 7.2. Average STAR scores for districts' Participation in Summer Programs, as a mean by 
year: 2007-08 through 2010-11. 

Sources: Pre-College Outreach Center (POC) Summer Program Attendance Data. 2009. 2010 and 201 1. 

Notes. POC began implementing summer programs in summer 2009. so 2007-08 data is not available. Responses are 
reported using a 5-point scale: (1)6 students attended or 20 % of available space. (2/ 12 students attended or 40% of 
available space. (3/ IS students attended or 60% of available space. (4/ 24 students attended or 80% of available 
space, and (5) 30 students attended or 100 % of available s/race. Appendix G contains more information about each 
of tlie core components, supporting components, and indicators used in the measurement of STAR implementation. 

Indicator Score: Students' Awareness of Postsecondary Opportunities 

ITic Students' Awareness of Postsecondary Opportunities indicator is measured using survey items that 
ask students to indicate their level of familiarity with ( I ) 4-ycar colleges and universities, (2) community 
and junior colleges, and (3) vocational and technical schools using the response categories: ( 1 ) not 
familiar. (2) somewhat familiar, and (3) very familiar. Researchers determined the average number of 
opportunities with which students were somewhat or very familiar at each STAR campus and converted 
averages to a 5-point scale in which (0.00 -1.67) indicates students were familiar with one type of 
postsecondary opportunity. ( 1 .68-3.34) indicates students were familiar with two types of opportunities. 
and (3.35-5.00) indicates students were familiar with each type tf postsecondary opportunity. Results 
presented in Figure 7.3 indicate that students at both STAR middle schools (2.73) and high schools (3.17) 
were familiar with about two types of postsccondary opportunities during the 2010-1 1 school year. 

Results for middle school students suggest that familiarity with the types of postsccondary opportunities 
dropped in the years after the lead STAR cohort moved to high school in 2008-09. 
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Figure 7.3. Average STAR scores for Students' Awareness of Postsecondary Opportunities, as a 
mean by year: 2007-08 through 2010-11. 

Sonnet: STAR Middle School and High School Student Surveys, spring 2008. 2009. 2010. and 201 1. 

Notes. Responses are reported using a 5-point scale. Students' Awareness of Postsecondary Oppotlunities: students 
are familiar with one type of postsecondary opportunity (0.00 -1.67). students are familiar with two opportunities 
ll.6S-3.34l. and students are familiar with all three types of /tostseeondary opportunity (3.35-5.00). Appendix G 
contains more information about each of the core components, supporting components, and indicators used in the 
measurement of STAR implementation. 

Trends in Students' Awareness of Postsecondary Opportunities 

Figures 7.4a. 7.4b. and 7.4c present students’ familiarity with each of the three types of postsccondary 
opportunities included in the Students' Awareness of Postsecondary Opportunities indicator discussed in 
the previous section. For each figure, percentages represent the sum of the percentage of students 
indicating they were somewhat familiar and the percentage of students indicating that they were very 
familiar with each type of postsccondary opportunity for each survey administration. 

Results presented in Figure 7.4a indicate that students' level of familiarity with 4-ycar colleges and 
universities has remained relatively stable across years, but that familiarity decreased somewhat at the 
middle school level once the lead STAR cohort moved to high school in 2008-0'). 
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Figure 7.4a. Students* familiarity with 4-year colleges and universities, as a percentage by year: 
2007-08 through 2010-11. 

Source: STAR Middle School and High School Surveys, spring 2008. 2009. 2010. and 2011. 

Note. Percentages are lire sum of tlw percentage students responding they were somewhat familiar and students 
responding they were very familiar with 4-year colleges and universities for each survey administration. 
*2007-08 (N- 1 .940 ); 2008-09 <N- 1 .8871; 2009- 1 0 <N= 1 .52 1 ); 2010-1 1 <N= 1.761) 

*2007-08 (N-3.371); 2008-09 (N-2.991); 2009-10 (>=3.075); 2010-1 1 |N=2J29) 


Figure 7.4b presents results for students’ level of familiarity with community colleges across survey 
years. Similar to results for 4-ycar colleges and universities (sec Figure 7.4a), findings indicate that 
middle school students’ familiarity with community colleges began to decline once the lead ST AR cohort 
moved to high school in 2008-09. but that high school students’ level of familiarity with community 
colleges has remained relatively stable across years. 
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Figure 7.4b. Students* familiarity with community colleges, as a percentage by year: 2007-08 
through 2010-11. 

Source. STAR Middle School and High School Surveys, spring 2008. 2009. 2010. and 2011. 

None. Percentages are the sum of tl« percentage students responding they were somewhat familiar and students 
responding they were very familiar with community colleges for each survey administration. 

*2007-08 (N- I.940K 2008-09 (N= 1.887 >; 2009-10 (N- 1.521); 2010-1 1 (N- 1.755) 

"2007-08 (N=3,37 1 ); 2008-09 <N=2.99 1 >; 2009-10 (N=3.075); 2010-1 1 |N=2J2I) 
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Figure 7.4c presents similar information for vocational or technical schools. Again, the trend for middle 
school students suggests that familiarity levels began to drop once the lead cohort moved to high school 
in 2008-09. Results for high school students indicate small increases in their familiarity with vocational or 
technical schools across project years. 
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Figure 7.4c. Students' familiarity with vocational or technical schools, as a percentage by year: 
2007-08 through 2010-11. 

Source: STAR Middle School and High School Surveys, spring 2008. 2009. 2010. and 2011. 

Note. Percentages aie the sum of live percentage students icsponding they were somewhat familiar and students 
responding they were very familiar with vocational oi technical schools for each survey administration. 

*2007-08 (N - 1 .940); 2008-09 <N- 1 .887); 2009- 1 0 <N= 1 .52 I >; 20 10- 1 1 (N= 1 .750) 
h 2 007-08 (N-3.371 »; 2008-09 <N=2.991); 2009-10 (N=3.075): 2010-11 (N=2J17) 

Indicator Score: Students’ Awareness of Entrance Requirements 

The Students' Awareness of Entrance Requirements indicator measures the degree to which STAR 
campuses provide students with information needed to improve their awareness of postsccondary entrance 
requirements. The evaluation's student surveys ask respondents to indicate whether a GEAR UP/STAR 
representative, a school counselor, a teacher, or an administrator has discussed postsccondary education 
entrance requirements with them. The Students' Awareness of Entrance Requirements indicator score 
reflects the percentage of students at each campus who indicated they had received information from at 
least one source and uses the following 5-point scale: ( 1) 20 % (2) 40 %, (3) 60 %, (4) 80 %, and (5) 100 % 
of students received information from at least tme school source (c.g.. a GEAR UP/STAR representative, 
a school counselor, a teacher, or an administrator). As presented in Figure 7.4. 72% of students in STAR 
schools (3.60 overall) received information about postsccondary entrance requirements from at least one 
school source during the 2010-1 1 school year, which marks a decrease relative to results for 2009-10. I hc 
source of this decrease is largely attributable to results for middle school students. In 2010-1 1 about 65% 
of middle school students reported receiving information about college entrance requirements from a 
school source compared to 75% in 2009-10. 
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Figure 7.5. Average STAR scores for Students' Awareness of Entrance Requirements, as a mean by 
year: 2007-08 through 2010-11. 

Sources: STAR Middle School and High School Student Surveys, spring 2008. 2009. 2010. and 201 1. 

Notes. Responses are reported using a 5-point scale: ( 1 ) 20%, (2) 40%. (3) 60%, (4) 80%. and (5) 100 % of students 
received information from at least one school source. Appendix G contains more information about each of the eore 
components, supporting components, and indicators used in the measurement of STAR implementation. 

Results presented in Table 7.1 present the full range of sources of information about college entrance 
requirements, including non-school sources such as parents and siblings, presented on the student 
surveys. Findings indicate that across years, students arc most likely to rely on parents for information, 
but that high school students have increasingly turned to school sources for information about college 
entrance requirements, while middle school students* reliance on school sources has generally declined 
over time. Across implementation years (i.c.. from 2007-08 to 2010-1 1 }, the percentage of high school 
students who received information about college entrance requirements from a GFAR UP representative, 
a teacher, and a school administrator increased by 17, 13. and 10 percentage points, respectively. In 
contrast, the percentage of middle school students receiving information from a GEAR UP representative 
declined by 23 percentage points. Declines in the percentages of middles school student receiving 
information from school administrators. (-3 percentage points) and counselors (-1 percentage point) were 
smaller, and the percentage of middle school students receiving information from teachers increased 
somewhat across years (+3 percentage points). In interviews conducted as part of the spring 201 1 site 
visits, some teachers said that their schools* participation in STAR motivated them to become more 
involved in providing students with information about college. One teacher explained: 

(Teachers) have become more of the college advocates for our kids — making them more aware of 
what's available to them. We always get wrapped up in our content (areas) and sometimes we 
forget to be the advertisers (of college) and GEAR UP has helped to bring that to the forefront. 
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Table.7.1. STAR Students* Sources of Information Regarding College Entrance Requirements, as a 
Percentage: 2007-08 Through 2010-11 




Middle School 1 



High School" 


Sources. 

2007-08 


2009-10 

2010-11 

2007-08 




Parents 

60.1% 

69.1% 

74.2% 

70.0% 

62.3% 

59.2% 

62.0% 

62.1% 

Counselors 

31.7% 

26.7% 

33.5% 

30.6% 

53.3% 

49.6% 

55.0% 

54.5% 

Teaelrers 

51.3% 

51.4% 

49.5% 

53.8% 

43.7% 

46.4% 

54.3% 

56.2% 

Another family member 

46.9% 

47.4% 

47.1% 


38.3% 

39.7% 

39,0°/.. 

39,0°/.. 

GEAR UP 
Representatives 

42.9% 

21.6% 

29.9% 

20.3% 

18.4% 

23.5% 

34.7% 

35.4% 

Siblings 

31.6% 

34.3% 

33.7% 

33.7% 

31.7% 

31.3% 

28.3% 

30.0% 

Administrators 

24.8% 

20.7% 

20.9% 

21.8% 

11.7% 

14.1% 

14.3% 

18.4% 

No one 

10.5% 


10.7% 

13.0% 

13.8% 


11.3% 

9.6% 


Source : STAR Middle School and High School Student Surveys, spring 2008, 2009, 2010, and 201 1. 
i Sole. Percentages will not total to 100. Students may have indicated multiple sources of information. 

'2007-08 |N= 1.940): 2008-09 1,887): 2009-10 (N-1.521 ); 2010-1 1 (N- 1,792) 

*2007-08 (N-3,37l); 2008-09 (N-2,991); 2009-10 <N-=3. 075); 2010-11 <N=2,37I) 

Indicator Score: Students’ Awareness of Financial Assistance 

The evaluation also considers Students' Awareness of Financial Assistance as an indicator of STAR 
implementation, and students responding to the spnng surveys indicated whether they received 
information about financial assistance for postsecondary educational opportunities from a school source 
{c.g., a GEAR UP/STAR representative, a school counselor, a teacher, or an administrator). The Students' 
Awareness of Financial Assistance indicator score measures the percentage of students at each STAR 
campus who reported receiving postsecondary planning information from at least one school source. 
Percentages have been converted to a 5-point scale: ( 1 ) 20%. (2) 40%, (3) 60S f, (4) X0%. and (5) 100% of 
students received information about financial assistance from at least one school source. 

As presented in Figure 7.6, about half (49%) of students in STAR schools received information from 
school staff regarding financial assistance during the 2010-1 1 school year. Not surprisingly, high schools 
earned higher Students' Awareness of Entrance Requirements (sec Figure 7.5) and Students' Awareness 
of Financial Assistance scores than middle schools, which likely reflect the greater emphasis on 
postsccondary planning at the high school level. The proportion of middle school students receiving 
information about financial assistance has decreased across implementation years. In 2010-1 1, only 38% 
of middle school students reported receiving financial planning information from a school source 
compared to 45% of students in 2009-10. This finding is consistent with results presented in Figure 7.5 
and suggests that the emphasis on providing middle school students with college planning resources 
declined after the lead ST AR cohort moved to high school in 2008-09. The cohort's move to high school, 
however, has not resulted in a corresponding increase in the percentage of high school students receiving 
information about financial assistance. Across survey years, the percentage of high school students 
reporting receiving information has remained relatively stable, ranging from 59% in 2009-10 to 56% in 
both 2007-08 and 2008-09. In 2010-1 1, 58% of high school students reported receiving information about 
financial assistance from a school source. 
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Figure 7.6. Average STAR scores for Students' Awareness of Financial Assistance, as a mean by 
year: 2007-08 through 2010-11. 

Sources: STAR Middle School and High School Student Surveys, spring 2008. 2000. 2010. and 201 1. 

Notes. Responses are reported using a 5-point scale: ( 1 ) 20%, (2» 40%, (3) 60%. |4 )H0%. and (5) J00K of students 
received information front at least one school source. Appendix (i contains more information about each of tl*r core 
components, supporting components, and indicators used in the measurement of STAR implementation. 


While the measurement of the Students' Awareness of Financial Assistance indicator score ts limited to 
school information sources, the spring surveys also asked students about other sources of information 
<c.g., parents and siblings). Table 7.2 presents the percentage of students reporting they received 
information across the full range of sources listed on surveys and indicates that large proportions of 
students rely on their parents and siblings for information about financial aid. Notably, about a third of 
middle school students (34%) and a quarter of high school students (25%) reported that they did not 
receive financial assistance information from any source during the 2010-1 1 school year. 


Across years, however, trends in students* responses indicate that high school students have increased 
their reliance on school sources of information. In particular, the percentage of high school students 
turning to GEAR UP representatives, teachers, and school administrators have increased by 11, 8, and 4 
percentage points, respectively, across the STAR implementation period. Middle school students* reliance 
on school sources of information has declined across years, with the most notable decline in the 
percentage of students receiving information from a GEAR UP representative (a drop of 21 percentage 
points). 
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Tabic. 7.2. STAR Students* Sources of Financial Assistance Information, as a Percentage: 2007-1 
Through 2010-11 


Sources 

2007-08 

Middle School 1 
2008-09 2009-10 2010-11 

2007-08 

High School" 
2008-09 2009-10 

2010-11 

Parents; 

52.9% 

54,8% 

51.2% 50.1% 

47.3% 

46.0% 

44.7% 

44.3% 

Counselors 

23.4% 

J 17.5% 

18.5% 1 

1 7.2% 

44.6% 

38.8% 

40.5% 

39.8% 

Teachers 

32.3% 

31.2% 

25.8% 

30.0% 

27.1% 

28.6% 

33.2% 

34.6% 

GKARUP 
Representatives 
Another family member 

32.1% 

14.5% 

15.6% 

11.1% 

14.6% 

18.8% 

25.4%, 

25.1% 

30.4% 

30.1% 

28.3% 

25.8% 

22.4% 

22.5% 

21.3% 

21.4% 

Siblings 

21.9% 

20.7% 

18.1% 

18.5% 

19.7% 

19.6% 

17.6% 

17.6% 

Administrators 

15.4% 

11.3% 

10.5% 

10.9% 

7.6% 

8.8% 

8.2% 

11.5% 

No one 

21.3% 

25.2% 

31.8% 

33.7% 

21.9% 

19.0% 

25.1% 

24.6%, 


Source: STAR Middle School and High School Student Surveys, spring 2008, 2009, 2010, and 201 1. 
Note. Percentages will not total to 100. Students may have indicated multiple sources of information. 
*2007-08 t N= 1 .940): 2008-09 [ N= 1 .887): 2009- 10 (N-1.521 ), 2010-11 (N-l .792) 

*2007-08 (N-3.371); 20084)9 (N-2,991 ); 2009-10 (N-0. 075); 2010-11 (N=2,37l) 


Students' and Parents’ Perceptions of the Affordability of Postsecondary Education 

The spring surveys also asked students and parents whether they thought postsecondary educational 
options were affordable using family income, scholarships, and financial aid. The figures that follow 
present the percentages of students and parents who thought that 4-year colleges and universities (Figure 
7.7a) and community colleges (Figure 7.7b) were affordable across survey years. For each figure, 
percentages represent the sum of the percentage of parents and students indicating they could probably 
afford each type of postsecondary opportunity and the percentage of parents and students indicating they 
could definitely afford each opportunity for each survey administration. 

Results presented in Figure 7.7a indicate that for both students and parents, perceptions of the 
affordability of 4-year colleges and universities as remained relatively constant across years. For each 
survey administration period, parents were the most confident of the affordability of 4-year colleges and 
universities, with 85% or more of parents across years indicating they could probably or definitely afford 
tuition. Middle school and high school students were less confident of the affordability of 4-year colleges 
and universities. Across years, just over 67% of middle school students and just over 58% of high school 
students thought their families could afford tuition. 
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Figure 7.7a. Students' and parents' perceptions of the affordability of 4-year colleges and 
universities, as a percentage by year: 2007-08 through 2010-1 1. 

Source: STAR Middle School and High School Surveys and STAR Parent Survey, spring 2008. 2009. 2010. and 
2011. 

Note. Percentages are the sum of the percentage students and parents responding that they eould probably afford the 
tuition at 4-year colleges and universities and the percentage students and parents responding that they could 
de/miicly afford the tuition at 4-year colleges ai*l universities for each survey administration. 

*2007-08 (N- 1 .940 1; 2008-09 (N= 1 .887). 2009- 1 0 (N= 1 .52 1 ); 2010-1 1 (N- 1 .76 1 ) 

B 2007-08 <N=3,371); 2008-09 <N=2.99I): 2009-10 (N-3,075); 2010-1 1 (N=2J29) 

'2007-08 (N-809):2008-09 N-670); 2009-10 <N=669); 2010-1 1 (N-619) 

Figure 7.7b presents results for community colleges. Similar to results for 4-ycar colleges and universities 
(see Figure 7.7a), parents arc highly confident in their ability to pay for community college, with more 
than 90% indicating they could probably or de/mitely that they could afford tuition. Although middle 
school students were initially less confident than high school students in their families* ability to pay 
community college tuition, their confidence generally increased across STAR implementation years, 
which may reflect greater awareness of the costs of postsccondary educational opportunities. 
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Figure 7.7b. Students' and parents' perceptions of the affordability of community college, as a 
percentage by year: 2007-08 through 2010-11. 

Source: STAR Middle School and High School Surveys and STAR Parent Survey, spring 2008. 2009. 2010. and 
2011. 

Note. Percentages are the sum of the percentage students and parents responding that they could probably afford 
community college tuition and the percentage students and parents responding that they could definitely afford 
community college tuition for each survey administration. 

*2007-08 (N- 1.940 ). 2008-09 (N-l .887); 2009- 1 0 <N= 1 .52 1 1; 20 10- 1 1 (N- 1 .76 1 > 
h 200?-08 <N=3,371); 2008-09 (N=2.991): 2009-10 (N=3,075); 2010-11 (N-2J29) 

"2007-08 (N=809): 2008-09<N-670); 2009-10 (N-669): 2010-1 1 (N-619) 

Supporting Component Score: Student Access to Information 

The overall Student Access to Information supporting component score is derived from the average of 
campuses* Student Informational Activities. Students' Participation in Summer Programs. Students* 
Awareness of Post secondary Opportunities. Students' Awareness of Entrance Requirements , and 
Students' Awareness of Financial Assistance indicator scores (sec Fxhibit 7.1). Because Student 
Informational Activities data were not collected dunng the 2007-08 evaluation year, scores for that year 
arc not included in the analysis. 

Findings presented in Figure 7.8 indicate that STAR campuses partially implemented activities and 
services designed to provide students with Access to Information (2.37 overall). Consistent with the 
understanding that postsecondary planning information is generally emphasized to a greater extent in high 
school, STAR high schools earned higher Student .Access to Information scores than middle schools in 
2010-1 1 (3.05 vs. 2.30). Middle school scores decreased in 201 1, continuing a pattern of decline that 
began in 2008-09 when the lead student cohort (seventh graders in 2006-07) advanced to high school. 

This pattern is reflected in analyses throughout this report and suggests that middle schools have placed 
less emphasis on STAR has since the first cohort moved to high school. 
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Figure 7.8. Supporting component scores: Student Access to Information, as a mean by year: 2007- 
OS through 2010-11. 

Sources,: STAR Middle School and High School Student Surveys, spring 2008. 2009. 2010. and 201 1. Pre-College 
Outreach Center (POC) Summer Attendance Data. 2009. 2010 and 201 1 . 

Notes. POC began implementing summer programs in summer 2009. so 2007-08 data are not available. Responses 
are reported using a 5-point scale: minimal (0.00 - 1 .50). ixiriial (1.51- 3.00). substantial (3.0 1 - 4.50). and/u// 
im/il erne niatton (4.51 - 5.00). Appendix G contains more information about each of the core components, 
supporting components, and indicators used in tl»c measurement of STAR implementation. 
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Seniors’ College Planning 


Each year, the spring student survey asks high school seniors about their coBege plans, including whether they have taken 
college entrance exams and completed application processes. Although the lead STAR cohort wil not complete the twelfth 
grade until the protects final implementation year (i.e.. 2011-12). each year, twelfth graders’ responses are used to indicate the 
perceptions ot seniors in participating schools, establish trends, and guide development of programming in future years. The 
follow ng sections present seniors' responses. 

College Entrance Exams 

As presented in Table 7.6. a larger proportion of seniors responding to the spring 201 1 survey had taken college entrance 
exams than in previous years. More than half of surveyed students had taken the PSAT (53%) and ACT (54%). and more than 
a third had taken the SAT (38%) in 201 1. Correspondingly, smaller proportions of students mrtcated they planned to take the 
PSAT. SAT. and ACT. and smaller proportions of students responded that they would not take the PSAT and SAT. 


Table 7.3. Seniors at STAR Campuses Entrance Exam Status, as a Percentage: 2007-08 
Through 2010-11 


Exam 

Exam Status 

Seniors 

2007-08 

Seniors 

2003-09 

Seniors 

2009-10 

Seniors 

2010-11 

(N-670) 

(N-584) 

(N-587) 

(N-418) 


Have taken 

47.8% 

50.1% 

39.0% 

52.5% 

PSAT 

Plan to take 

7.1% 

9.7% 

8.6% 

5.5% 

Will not take 

21.7% 

19.2% 

21.5% 

16.9% 1 


Unsure 

23.5% 

21.1% 

30.9% 

25.1% | 


Have taken 

25.1% 

27.7% 

26.8% 

38.3% ! 

SAT 

Plan to take 

26.6% 

26.6% 

24.0% 

21.3% 

Will not take 

24.8% 

23.4% 

24.0% 

20.1% i 


Unsure 

23.6% 

22.4% 

25.2% 

20.3% 


Have taken 

52.8% 

49.2% 

50.4% 

54.0% i 

ACT 

Plan to take 

23.3% 

24.8% 

23.4% 

18.1% 

Will not take 

9.6% 

9.7% 

8.4% 

10.0% ! 


Unsure 

14.3% 

16.4% 

1 7.9% 

17.9% ' 


rrt Survey, spnnq 2008, 2009. 2010. and 201 1 . 



Note. Percentages may not total to 100 due to rounding. 2009-10 and 2010-1 1 only include data from 
five Ostncts. One efts Diet did not administer student surveys to seniors. 

Seniors responding to the spnng surveys are also asked about their postsecondary apptcaBon status and Tatte 7.7 presents 
their responses across years. In 2010-1 1 a larger proportion of surveyed seniors reported that they either had been accepted 
(29%) or had applied (23%) to a community college than in prev.ous years. While a smaller proportion of 2010-11 seniors had 
been accepted to a vocational school (4%). a somewhat larger proportion (6%) had applied than in prior years. Resu«s for 4- 
year colleges remain roughly consistent across years with about a third of sectors reporting that they had been accepted and 
between 13% and 19% reporting that they had appied to a 4-year program at the time of spnng suA'eys. 



from 2009-10 and 2010-1 1 only include <Hta from live districts. One «sbict did mol administer student survey's 
to seniors. 


Table 7.4. Seniors at STAR Campuses Application Status, as a Percentage: 2007-08 
Through 2010-11 


Program 

Application 

Status 

Seniors 

2007-08 

Seniors 

2008-09 

Seniors 

2009-10 

Seniors 

2010-11 

(N-670) 

(N-584) 

(N-587) 

(N-418) 

Four-Year 

University 

Accepted 

34.2% 

33.2% 

33.9% 


Applied 

17.1% 

18.5% 

12.8% 

18.0% 

Plan to apply 

28.4% 

30.1% 

35.0% 

33.3% 

Community 

College 

Accepted 

21.8% 

18.6% 

17.9% 

28.6% 

Applied 

16.8% 

16.6% 

15.3% 

23.0% 

Plan to apply 

34.2% 

32.8% 

35.2% 

27.2% 

Vocational 

School 

Acceded 

5.0% 

6.8% 

5.0% 

3.8% 

Applied 

3.1% 

4.3% 

3.1% 

5.9% 

Plan to apply 

22.6% 

urvey. spnng 20 
Resoonse caie 

21.9% 

38. 2009. 2010. 
oofv *W not a 

27.4% 
and 2011 . 
qqIv* is Qrrvtted fr« 

25.1% 

>m the table. Rest 


PARENT ACCESS TO INFORMATION 


Recognizing that planning for postsecondary education is the charge of both students and parents, the 
evaluation also considers the extent to which parents of students attending STAR schools receive 
information that will support their ability to plan for students' ongoing education needs, including college 
entrance requirements, financial assistance, and required courscwork. In measuring Parent Access to 
Information . the evaluation relies on three indicators: ( 1 ) Parent Access to Partial Information. (2) Parent 
Access to Fall Information, and (3) Parent Awareness of GEAR UP/STAR (see Exhibit 7. 1 ). 

Indicator Score: Parent Access to Partial Information 

Parents responding to the evaluation's spring surveys indicated whether a GEAR UP representative or 
school staff member had spoken with them about college planning, including entrance requirements, 
financial assistance, and course selection. The Parent Access to Partial Information indicator measures 
the percentage of parents receiving information addressing at least one college planning topic, using a 
5-point scale: ( I ) 20'. f of parents. (2) 40% of parents. (3) 60** of parents. (4) 80% of parents, and (5) 

/ 00 '% of i>arents received information about at least one college planning topic. 

Figure 7.9 presents indicator scores for parents of students attending STAR middle schools and high 
schools across 4 evaluation years. Results indicate 32% of surveyed parents received information about 
college entrance requirements, financial assistance, or course selection ( 1 .62 overall) during the 2010-1 1 
school year. Not surprisingly, a larger proportion of high school parents (36%) received planning 
infonnation from school staff than middle school parents (26%) in 2010-1 1, which likely reflects a greater 
emphasis on college planning in high school. The proportion of parents receiving information has largely 
decreased across implementation years. 


100?; of 
Campus Parents 
( 5.001 


6054 of 

Campus Parents 
(3.001 


20% of 

Campus Parents... 



STAR Middle Schools STAR High Schools STAR Average 



Figure 7.9. Average STAR scores for Parent Access to Partial Information, as a mean by year: 
2007-08 through 2010-11. 

Source: STAR Parent Survey, spring 2008. 2009. 2010. and 2011. 

Notes. Responses are reported using a 5-point scale: ( I ) 20% of parents. (2) 40% of parents. (3) 60% of parents. (4) 
80% of parents, and (5) 100% of parents received information regarding at least one college planning topic. 
Appendix G contains more information about each of the core compoiKnts. supporting components, and indicators 
used in the measurement of STAR implementation. 
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Indicator Score: Parent Access to Full Information 


The Parent Access to Full Information indicator score represents the percentage of parents who received 
information about each college planning topics (i.c., college entrance requirements, financial assistance, 
and required couiscwork) using a 5-point scale: ( 1 ) 20% of parents, (2) 40% of parents, (3) 60% of 
parents. (4) 80% of parents, and (5) 100% of parents received information about each topic. As presented 
in Figure 7.9. on average, only 14% of surveyed parents (0.69 overall) received infomiation about each 
planning topic in 2010-1 1 . Similar to findings presented in Figure 7.8. a larger proportion of high school 
parents ( 16%) reported receiving fall information than middle school parents (5%). which, again, reflects 
the greater emphasis on college planning at the high school level. 


lOOtt of 

Surveyed Parents 
<5.00) 

60 '4 of 
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<3.00) 

20*4 of 

Surveyed Parents 

( 1 . 00 ) 



Figure 7.10. Average STAR scores for Parents Access to Full Information, as a mean by year: 2007- 
OS through 2010-11. 

Source: STAR Parent Survey, spring 2008. 2009. 2010. and 2011. 

Notes. Responses are reported using a 5-point scale: ( 1 ) 20% of parents, (2) 40% of parents, (3) 60% of parents. (4) 
80% of parents, and (5) 100 % of parents received infomiation regarding all three college planning topics. Appendix 
G contains more information about each of the core components, suppoiting components, and indicators used in the 
measurement of STAR implementation. 

Indicator Score: Parent Awareness of GEAR UP, STAR 

The spring surveys also asked parents about their familiarity with the GEAR UP/STAR program ( Parent 
Awareness of GEAR UP/STAR). Indicator scores arc presented using a 5-point scale: not familiar at all 
(1.00-1.25). not very familiar ( 1 .26-2.50). somewhat familiar (2.51-3.75). and very familiar (3.76-5.00). 
As presented in Figure 7. 1 0, on average, parents were somewhat familiar (2.67) with the GEAR 
UP/STAR program in 2010-1 1. Findings indicate that parents at STAR middle schools (2.72) were more 
familiar with the program than high school parents (2.63). This result is likely a reflection of the 
characteristics of some STAR partner activities designed to engage parents in schooling as well as 
differences in parent involvement by level of schooling. Across STAR districts, administrators said that 
partner activities focused on engaging parents in school were more appropriate for middle school students 
than for high school students, and some districts limited these activities to the middle school. This result 
is discussed in more detail in chapter 10. 


73 






Very Familiar 
<3.76 - 5.00) 


Somewhat Familiar 
(2.51-3.75) 


Not Very Familiar 
(1.26-2.50) 


Not Familiar at All 
(0.00- 1.25) 



Figure 7.1 1. Average STAR scores for Parent Awareness of (JEAK UP/STAR. as a mean by year: 
2007-08 through 2010-11. 

Source: STAR Parent Survey, spring 2008. 2000. 2010. and 2011. 

Note*. Responses are reported using a 5-point scale: not familiar at all (0.00- 1 .25). nor tery familiar ( 1 .26-2.50). 
somewhat familiar (2.5 1-3.75). and tery familiar (3.76-5.00). Appendix G contains more information about eaeh of 
the core components, supporting components, and indicators used in the measurement of STAR implementation. 

Supporting Component Score: Parent Access to Information 

'Ihc supporting component score for Parent Access to Information is the average of campuses* Parent 
Access to Partial Information. Parent Access to Fall Information . and Parent Awareness of GEAR 
UP/STAR scores. Findings presented in Figure 7. 1 1 indicate that STAR schools earned an overall Parent 
Access to Information score of 1 .66. or STAR schools partially implemented activities and services 
designed to increase parents* access to postsccondary planning information. 
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Figure 7.12. Supporting component scores: Parent Access to Information, as a mean by year: 2007- 
OX through 2010-11. 

Source: STAR Parent Survey, spring 2008. 2009. 2010. and 201 1 

Notes,. Responses are reported using a 5-point scale: minimal (0.00 - l.50)./*iifi<(/(1.51 -3.00), substantial (3.01 - 
4.50), and fall implementation (4.51 - 5.00). Appendix G contains more information about each of the core 
components, supporting components, and indicators used in the nKasurement of STAR implementation. 

CORE COMPONENT SCORE: INCREASING STUDENT AND PARENT ACCESS TO 
INFORMATION 

The core component score for Increasing Parent anti Student Access to Information is the average of 
campuses' supporting component scores for ( 1 ) Student Access to Information and <2 ) Parent Access to 
Information. Because Student Informational Activities data were not collected in 2007-08. scores for that 
year arc not included in the analysis. As presented in Figure 7.12, STAR campuses had an overall, 
average score of 2.01 for the 2010-1 1 school year, which indicates that schools partially provided parents 
and students with access to college planning information and represents a decline from scores in previous 
years. While results have remained fairly consistent at the high school level, scores have declined 
consistently across years at the middle school level. This pattern supports the conclusion that STAR has 
received less emphasis in middle schools since the grant's lead cohort moved to high school in 2008-09. 
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Figure 7.13. Cure component score: Increasing Student and Parent Access to Information, as a 
mean by year: 2007-08 through 2010-11. 

Sources: STAR Middle School and High School Student Surveys, spring 2008. 2009. 2010. and 201 1. STAR Parent 
Survey, spring 2008. 2009. 2010. and 2011; Pre-College Outreach Center (POC) Summer Program Attendance Data. 
2009. 2010. and 2011. 

Notes. POC began implementing summer programs in summer 2009. so 2007-08 data is not available. Responses arc 
reported using a 5-point scale: minimal (0.00 - 1.50). partial (1.51 - 3.00). suhuantial (3.01 4.50). and full (4.51 - 
5.00). Appendix G contains more information about each of the core components, supporting components, and 
indicators used in the measurement of STAR implementation. 
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The Educational Aspirations of Parents and Students at STAR Campuses 


The evaluation's spring surveys ask students what level ot education they expect to achieve and ask 
parents the level of education they expect their child to achieve. Table 7.8 presents students' responses, 
and Table 7.9 presents parents' responses. Results presented in Table 7.8 indicate that most students 
plan to participate in postsecondary education, but that students' aspirations have not changed much 
across STAR implementation years. For example, for each survey administration, roughly a third (33%) of 
high school students have responded that they planned to earn a bachelor's degree and there is little 
variation in the percentages of high school students who responded that they would earn an associate's or 
graduate degree. Middle school students' responses also show little variation across years. 


Table. 7.5. STAR Students' Educational Aspirations, as a Percentage: 2007-08 Through 2010-11 


Educational 


Middle School* 


Hiqh School" 


Aspiration 

2007-08 | 

2008-09 I 2009-10 1 2C 

110-1 1 1 2007-08 

1 2008-09 1 2009-10 

| 2010-11 

Less than high 
school 


, 0% °- 9% k 

| 0y/ ° 

0.3% 0.4% 



High school 



Associate s degree 


Bachelor s degree 
Graduate or 
protesslonal degree 


Don't know 


Source. STAR Mddle School and High School Studeni Surveys, spring 2008. 2009. 2010. and 201 1 . 
‘2007-08 (N- 1.940): 2008-09 (N-1.837): 2009-10 IN-1.521): 2010-11 (N-1.675). 

*2007-08 (N— 3.37 1 ). 2008-09 IN-2.991): 2009-10 (N-3.07S); 2010-11 (N-2.263) 


Most parents surveyed in spring 201 1 also expected their children to obtain a bachelor's, or 4-year degree 
and percentages in are roughly similar across parents of middle school and high school students (65% vs. 
62%). However, the percentage of both middle school and high school parents who expect their child to 
achieve a bachelor's degree has decreased across years. In 2010-11. the decrease in the percentage of 
parents' expecting a bachelor's degree is offset by a corresponding increase in the percentage of parents 
expecting their children to only complete high school. Trends across both middle schools and high school 
parents also reflect decreases in the percentages of parents who 'don't know” the level of education their 
child will achieve, which may indicate parents are giving greater thought to postsecondary outcomes. 


Table 7.6. Parents' Educational Aspirations for Their Children, as a Percentage: 2007-08 
Through 2010-11 





SUMMARY 


This chapter's findings indicate that STAR districts partially implemented activities and services focused 
on increasing student and parent access to postsccondary planning information in 2010-1 1. Similar to 
results presented in other chapters, the analyses included here indicate that STAR implementation has 
diminished at the middle school level since the lead S PAR cohort (seventh graders in 2006-07) moved to 
high school. Middle school students arc participating in fewer programs and activities designed to 
increase their awareness of and preparation for postsccondary education. Similarly, the parents of middle 
school students reported reduced access to college planning information since the lead cohort moved to 
high school in 2008-09. Middle school parents, however, tended to he more aware of GEAR UP 
implementation efforts at their students* schools. 

Although not directly attributable to STAR, more high school seniors took college entrance exams in 
2010-1 1 than in previous years, and larger percentages of surveyed seniors had applied to postsccondary 
programs. While the percentage of seniors who had been accepted to 4-year colleges at the time of 
surv eys (i.c.. May) has remained about the same across evaluation years, the percentage of seniors who 
have been accepted to community colleges increased substantially in 201 1. While seniors in 201 1 did not 
participate in STAR services, their increased participation in college testing and application processes 
suggests that STAR's focus on preparing students for college has permeated the culture of high schools 
and is affecting student outcomes. 
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Chapter 8 

Building School and Community Cultures That Support Academic 
Achievement 


Building school and community support for increased academic achievement is a core component of 
STAR, and participating districts strive to develop environments that foster postsccondary goals and to 
engage parents and the larger community in building college-going cultures. In measuring school and 
community support, the evaluation considers the environment of STAR campuses {School Environment ), 
including buy-in for project goals and support for innovation. In addition, the evaluation examines Parent 
and Community Support . including parent support for students* academic goals. Exhibit 8.1 illustrates the 
structure of this analysis and its place within the larger context of STAR implementation. More 
information about core components, supporting components, and indicators is included in Appendix G. 


Exhibit 8.1 



DATA SOURCES: SCHOOL AND COMMUNITY CULTURES 

The evaluation's measurement of school and community culture relics on data collected through ( I ) 
spnng surveys of teachers on STAR campuses and (2) spring surveys of STAR parents. Sec Appendix G 
for more information on the measurement of the School Environment and Parent and Community Support 
supporting components. In addition, the discussion includes qualitative data collected through interviews 
with administrators and counselors, as well as focus group discussions with teachers conducted during 
spring 201 1 site visits. The sections that follow discuss the evaluation's approach to measuring school 
and community cultures that support school and STAR initiatives, and provide measures of the degree to 
which positive school and community cultures were present in 2010-1 1 . Results are presented for middle 
schools, high schools, and all STAR campuses across 4 implementation years (2007-08, 2008-09, 2009- 

10 . and 2010 - 11 ). 
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MEASURING THE SCHOOL ENVIRONMENT 


As presented in Exhibit 8.1, the evaluation considers two indicators — ( l ) Leadership and Buy-in and (2) 
Innovative Environment — in measuring STAR school environments. Both indicators rely on teachers* 
levels of agreement with spring survey items that use the following 5-point scale: ( 1 ) strongly disagree, 
(2) disagree , (3) unsure , (4) agree , or (5) strongly agree. Responses are averaged at the teacher level and 
then at the school level to create a score for each campus. The figures included in the following sections 
present campus scores averaged across middle schools, high schools, and for all STAR campuses. 

Indicator Score: Leadership and Buy-In 

Each year, teachers on STAR campuses indicate their level of agreement with statements addressing the 
level of Leadership and Buy-In for STAR implementation, including whether principals communicate 
STAR goals and establish clear expectations for students' academic outcomes, as well as whether 
principals and teachers support vertical teaming efforts. As presented in Figure 8.1, teachers generally 
agreed (3.71 overall) that staff were committed to implementing STAR in 2010-1 1 and that school 
leadership supported implementation efforts. Although scores for Leadership and Buy-In have been 
strong across years, in interviews, staff across districts said that high rates of administrative turnover 
created leadership challenges. For example, one STAR high school has had five principals since the 
beginning of the grant, and another has had five principals over the 2009-10 and 2010-11 school years. 


Strongly Agree 

(5.00) 

Agree 

(4.00) 

Insure 
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Strongl\ Disagree 

( 1 . 00 ) 


Figure 8.1. Average STAR scores for Leadership and Buy-In, as a mean by year: 2007-08 through 
2010 - 11 . 

Sources: STAR Teacher. Counselor, and Librarian Survey, spring 2008. 2009. 2010. and 2011. 

Notes. Scores aic reported using a 5-point scale: ( 1 ) strongly disagree . (2) disagree . (3) unsure . <4 ) agree, or (5) 
strongly agree. Appendix G contains more information about each of live core components, supporting components, 
and indicators used in the measurement of STAR implementation. 

Indicator Score: Innovative Environments 

In addition, teachers responding to spnng surveys also indicated their level of agreement with statements 
about campuses' Innovative Environments , including whether staff were encouraged to attend 
professional development, implement new strategics, and take risks. As presented in Figure 8.2. teachers 
generally agreed <3.86 overall) that their campuses supported innovation, but to a somewhat lesser extent 
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than levels reported in 2009-10 (3.94). The decline in overall agreement can be attributed to high school 
responses (3.77). which represent lower levels of agreement than reported in 2009-10 (3.91). In contrast, 
scores for middle schools increased in 2010 - 1 1 . 
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(5.00) 

4.00 

Agree 

3.50 
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Figure 8.2. Average STAR scores for Innovative Environments, as a mean by year: 2007-08 
through 2010 - 11 . 

Sources: STAR Teacher. Counselor, and Librarian Survey, spring 2008. 2009. 2010. and 2011. 

Notes. Scores aie reported using a 5 -point scale: (I ) strongly disagree, (2) disagree, (3) unsure . (4) agree . or (5) 
strongly agree. Appendix G contains more information about each of the core components, supporting components, 
and indicators used in the measurement of STAR implementation. 


Supporting Component Score: School Environment 


The School Environment supporting component score is the average of campuses* ( 1 ) Leadership and 
Haydn and (2) Innovative Environments indicator scores. STAR schools earned high School Environment 
scores (3.79 overall) in 2010-1 1, which indicates substantial buy-in and support for the STAR program 
dunng the project's filth year. Across implementation years, middle schools have had somewhat higher 
scores than high schools. 
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Figure 8.3. Supporting component scores: School Environment, ns a mean by year: 2007-08 
through 2010 - 11 . 

Sources: STAR Teacher. Counselor, and Libraiian Survey, spring 2008. 2009. 2010. and 2011. 

Notes. Scores are repotted using a 5-point scale: minimal (0.00 - 1 .50). ixtriial ( 1 .5 1 - 3.00), substantial (3.01 - 
4.50). aikd/n// (4.51 - 5.00). Appendix G contains more information about each of the core components, supporting 
components, and indicators used in the measurement of STAR implementation. 

MEASURING PARENT AND COMMUNITY SUPPORT 

As presented in Exhibit 8.1 . the evaluation considers three indicators when measuring parent and 
community support for STAR school initiatives: ( I ) Parent and Community Engagement in School 
Activities. (2) Parents' Support of STAR Coals at Home, and (3) Parents' Participation in School and 
STAR Activities. The sections that follow present information about each indicator as well as the overall 
score for the Parent and Community Support component of STAR implementation. 

Indicator Score: Parent and Community Engagement in School Activities 

In measuring Parent and Community Engagement in School Activities, the evaluation's spring teacher 
surveys ask respondents to rate their level of agreement with statements asking about parents' and 
community members' awareness of STAR activities, opportunities for involvement in school activities, 
and support for college readiness goals using a using a 5-point scale: < I ) strongly disagree. (2) disagree, 
(3) unsure. (4) agree, or (5) strongly agree. As in the previous chapter section, responses arc averaged at 
the teacher level and then at the school level to create a score for each campus. Figure 8.4 presents 
campus scores averaged across middle schools, high schools, and for all STAR campuses. 

On average, tcachcis tend to agree (3.59 overall) that parents and communities were engaged in school 
activities during the 2010-1 1 school year, with scores increasing at both the middle school and high 
school levels over those reported in 2009-10. 
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Figure 8.4. Average STAR scores for Parent and Community FIngagenient in School Activities, as a 
mean by year: 2(M)7-(>8 through 2010-11. 

Sources: STAR Teacher. Counselor, and Librarian Survey, spring 2008. 2009. 2010. and 2011. 

Notes. Responses are reported using a 5-point scale: (I ) strongly disagree, (2) disagree, (3) unsure . (4) agree, or (5) 
strongly agree. Appendix Ci contains more information about eaeli of tire core components, supporting components, 
and indicators used in the measurement of STAR implementation. 


Indicator Score: Parents' Support ot STAR Goals at Home 

lhc indicator score for Parents' Support of STAR Goals at Home is measured using results from spring 
parent surveys. The parent survey asks respondents about the frequency with which they participate in 
home activities that support STAR goals. Such activities include prov iding tutoring, talking about college, 
selecting appropriate courscwork. and so on. Parents indicate the frequency of their participation using a 
4-point scale: ( 1 ) never, (2) several times a month . (3) set era! times a week, or (4) every day. Responses 
arc converted to a 5-point scale to align with other measures of implementation, l hc converted 5-point 
scale roughly approximates survey responses and includes: never (0.00-1.25), several times a month 
{ 1 .26-2.50). several times a week (2.5 1 -3.75). and every day (3.76-5.00). (See Appendix G for the specific 
survey items.) 

Figure 8.5 presents Parents’ Support of STAR Goals at Home scores disaggregated by school type and for 
all STAR campuses. Results indicate that parents provide support for most activities several times a week 
(3.35 overall) in 2010-1 1. This result has been consistent across survey years at both the middle school 
and high school levels and likely reflects parents ongoing involvement in their students' education 
unrelated to STAR. 
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Figure 8.5. Average STAR scores for Parents’ Support of STAR Goals al Home, as a mean bv year: 

2007- 08 through 2010-11. 

Soimes: STAR Parent Survey, spring 2008. 2009. 2010. and 201 1. 

Notes. Responses are reported using a 5-point scale: never (0.00-1.25 ). several limes a month (1.26-2.50). several 
times a week (2.5 1 -3.75). and even- day (3.76-5.00). Appendix G contains more information about each of the core 
components, supporting components, and indicators used in the measurement of STAR implementation- 

indicator Score: Parents' Participation in School and STAR Activities 

The evaluation also measures Parents’ Part It ipution in School and STAR Activities using parents' 
responses to spring surveys. The survey asks parents whether they have participated in a range of school 
activities, such as parent-teacher conferences. PTA events, and meetings with school staff (e.g., 
counselors) to plan their student's education. Using responses, researchers found the percentage of 
parents at each campus that had attended at least five school activities and converted the percentages to a 
5-point scale relative to the STAR goal of 50%: < 1 ) 10%, (2) 20%. (3) 30%, (4) 40%. and (5) 50% of 
parents attended five or more activities. Sec Appendix F for more detailed information about the STAR 
goals). 

Figure 8.6 presents scores for Parents’ Participation in School and STAR Activities across 4 years. In 
comparison to the 2009-10 evaluation year, average scores for Parents' Participation in School and MAR 
Activities increased in 2010-1 1 (44% vs. 42% in 2009-10). but still lagged levels observed in 2007-08 and 

2008- 09. To some extent, the decline in parent participation in the later years of the grant may be 
attributable to a reduced focus on parents in some districts. Noting the difficulty of increasing parent 
involvement in school activities, some administrators said that they focused their efforts on grant 
activities targeted to students and teachers because they saw a greater "return" on these efforts. 
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Figure 8.6. Average STAR scores for Parents' Participation in School and STAR Activities, as a 
mean by year: 2007-08 through 2010-11. 

Sonnes: STAR Parent Survey, spring 2008. 2009. 2010. and 201 1. 

Notes. Responses are reported using a 5-point scale: ( I ) /Oft. (2) 20ft, (3) 30ft. (4 1 40ft. and (5) 50ft of patents 
attended five or mote activities. Appendix G contains more information about each of the core components, 
supporting components, and indicators used in tl»e measurement of STAR implementation. 


Supporting Component Score: Parent and Community Support 

Parent atu! Community Support supporting component scores arc the average of campuses' < 1 ) Parent 
and Community Engagement in School Activities. (2) Parents' Support of STAR Goals at Home . and (3) 
Parents' Participation in School and STAR Activities scores. As presented in Figure 8.7. STAR campuses 
earned relatively high Parent and Community Support scores (3.79 overall), which indicates substantial 
support from parents and the local community for S TAR goals. 
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Figure 8.7. Supporting component scores: Parenl and Community Support, as a mean bv year: 
2007-08 through 2010-11. 

Sources: STAR Teacher. Counselor, and Librarian Survey, spring 2008. 2009. 2010. and 201 1: STAR Parent 
Survey, spring 2008. 2009. 2010. and 2011. 

Notes. Responses are reported using a S-point scale: minimal <0.00 - 1 .50 ). /mniiil ( 1 .5 1 -3.00). substantial (3.01 
4.50). and/u// (4.51 - 5.00). Appendix G contains more information about each of the core components, supporting 
components, and indicators used in tire measurement of STAR implementation. 


The Challenge of Raising Community Expectations 

Across STAR districts, school stall highlighted the challenge of raising (heir local communities' 
expectations lor students. One administrator commented that 'contentment is easily attained in this 
community.' noting a general lack ol academic ambition among residents. An administrator in another 
district shared a similar view, explaining that there was 'mismatch ol expectations' and that parents 
and students resisted the understanding that rigorous academic content was necessary lor students to 
be prepared lor postsecondary opportunities. As evidence of this trend, the administrator reported that 
even the district's high achieving students (those in the top 10% ol their class) had to take remedial 
courses when they went to college. In all districts, interviewed stall said that they worked to send a 
message to the parents and the larger community that expectations lor students have to change. As 
one administrator explained: 

We want to crank out ol here college-ready students that are going to go to college, and that’s 
the expectation. Yes. it's a dream, but it shouldn't be a dream— it's the expectation. The 
dream should be that they (students) graduate Irom college and go on to graduate school. 
That's the dream. But lor us the expectation should be that they are going to go to college. 









CORE COMPONENT SCORE: BUILDING SCHOOL AND COMMUNITY CULTURES THAT 
SUPPORT ACADEMIC ACHIEVEMENT 


The core component score Building School and Community Cultures that Support Academic Achievement 
is derived from the average of campuses' ( I ) Schott! Environment and (2) Parent and Community Support 
supporting component scores (sec Exhibit 8.1). As presented in Figure 8.8. campuses implemented 
activities and services designed to Build School and Cotnmunity Cultures that Support Academic 
Achievement at a substantial level in 2010-1 1 (3.79 overall). STAR campuses earned slightly higher 
scores in 2010-1 1 relative to 2009-10 (3.79 overall), but trends across implementation years show little 
change in terms of the effects of STAR on school and community culture at either the middle school or 
high school level. 
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Figure 8.8. Core component scores: Building School and Community Cultures That Support 
Academic Achievement, as a mean by year: 2007-08 through 2010-11. 

Source: STAR Teacher. Counselor, and Librarian Survey, spring 2008. 2009. 2010. and 201 1. STAR Parent Survey, 
spring 2008. 2009. 2010. and 201 1. 

Note. Responses arc reported using a 5-point scale: minimal (0.00 - 1.50l /xirtial (1.51 - 3.00). substantial (3.01 - 
4.50k and full (4.51 - 5.(X)). Appendix G contains more information about eac h of the core components, supporting 
components, and indicators used in the measurement of STAR implementation. 

SUMMARY 

As in previous years, schools substantially implemented STAR activities and sendees designed to build 
school and community cultures that support academic goals in 2010-1 1. However, relative to previous 
years, scores declined somewhat in 2009-10 and 2010-1 1. In interviews, school staff said that it was 
difficult to change the culture of schools and communities and that sonic parents resisted the idea that 
rigorous instruction and challenging courscwork were necessary to improve students* preparation for 
postsccondary education. As a result, administrators in at least one district reported that they focused their 
implementation efforts on aspects of STAR that directly affected students and focused less on parents and 
the larger community. 
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Chapter 9 

Implementation Scores 


Ultimately. STAR campuses cam aggregate implementation scores derived from the average of their 
scores for each of STAR'S four core components: ( I ) Raising Academic Standards . (2) Engaging 
Teachers and Students. (3) Increasing Student and Parent Access to Information . and (4) Building School 
and Community Cultures that Support Academic Achievement ( see Exhibit 9.1 >. Implementation scores 
arc designed to provide an overall measure of districts' progress in implementing the STAR program, and 
in combination with scores for core components, supporting components, and indicators, to allow districts 
to gauge their areas of strength and weakness and develop strategics for ongoing implementation. 



Im retting Mudiot and 
t'urcnt Acres* lo 
Information 


Building School and 
( onnisiunlt) C ultures thut 
Support Acudemic 
Achievement 


Engaging TcBrtirr* 
and Students 


Raising Academic 
Standards 


Exhibit 9.1 


CORE COMPONENT SCORES 


Figure 9. 1 presents the average core component scores for each of STAR'S program components (Raising 
Academic Standards. Engaging Teachers and Students . Increasing Student and Parent Access to 
Information, and Building School and Community Cultures that Support Academic Achievement) across 
implementation years (2007-08, 2008-09. 2009-10. and 2010-1 1 ). As noted in chapter 4. measurement of 
STAR implementation began in the project's second year (2007-08) because the short timeline available 
for 2006-07 implementation 1 ' precluded STAR districts from fully addressing most program components 
during the project's first year. Increasing Student and Parent Access to Information scores were not 
available for the 2007-08 evaluation year because some data for this component were collected differently 
in the early years of STAR. 


Results indicate that schools have implemented the Engaging Teachers and Students and Building School 
and Community Cultures components at a substantial level. The trend in scores for Raising Academic 
Standards is generally positive, although scores remain at the level of partial implementation. Scores for 
the Increasing Student and Parent Access to Information component also indicate partial implementation; 
however, the trend across years suggests reduced levels of implementation in 2010 - 11 . 


‘'Most STAR districts did not receive their grant awards until November 2006. and did not fully begin 
implementing until spring 2007. 
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Figure 9.1. Aggregate component scores, as a mean by year: 2007*08 through 2010-1 1. 

Source*. STAR Classroom Observations, spring 2008. 2009. 2010. and 201 1; College Board School Integrated 
Summary Reports: Advanced Placement Examination Performance and Participation Overview and Texas 
Education Agency Academic Excellence Indicators System enrollment data: 2007-08. 2008-09. 2009-10. and 2010- 
1 1: STAR Teacher. Counselor, and Librarian Surveys. Middle School and High School Student Surveys, and Parent 
Surveys spring 2008. 2009. 2010. and 2011: Public Education Information Management System iPEIMS) 2006-07. 
2007-08. 2008-09. and 2009-10 attendance data: POC Summer Program Attendance Records. 2008-09. 2009-10. 

and 2010-11. 

Notes. NA-not applicable. Some data were not collected across all evaluation years. Responses are reported using a 
5-point scale: minimal (0.00 - 1 . 50). panud( 1.5 1 3.00), substantial (301 4.50). and full <4.51 -5.00). Appendix 
G contains more information about each of the core components, supporting components, and indicators used in the 
measurement of STAR implementation. 

IMPLEMENTATION SCORES 

Figure 9.2 presents overall Implementation scores, derived from an average of ST AR campuses’ scores 
across program components. For the 2007-08 school year, scores arc based on only three components 
(i.c.. Raisin g Academic Standards. Engaging Teachers and Students, and Building School and Community 
Cultures that Support Academic Achievement ) because some data used to measure the Increasing Student 
and Parent Access to Information were not available for this year. The scores for remaintng arc based on 
all four components. 

STAR schools earned a score of 2.93 overall during the project’s fifth year, which indicates that schools 
approached substantial implementation levels in 201 CM 1. Although changes arc small, the trend in the 
STAR average suggests that implementation of STAR is diminishing across years. This trend is most 
apparent at the middle school level and may indicate that STAR implementation has received less 
emphasis since the grant’s lead cohort moved to high school. 
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Figure 9.2. Aggregate implementation scores, as a mean by year: 2007-08 through 2010-11. 

Source*’. STAR Classroom Observations, spring 2008. 2009. 2010. and 201 1; College Board School Integrated 
Summary Repons: Advanced Placement Examination Performance and Participation Overview and Texas 
Education Agency Academic Excellence Indicators System enrollment data: 2007-08. 2008-09. 2009-10. and 2010- 
1 1: STAR Teacher, Counselor, and Libiarian Surveys. Middle School and High School Student Surveys, and Parent 
Surveys spring 2008. 2009. 2010. and 2011: Public Education Information Management System (PEIMS) 2006-07. 
2007-08. 2008-09. and 2009-10 attendance data: POC Summer Program Attendance Records. 2008-09. 2009-10. 

and 2010-11. 

Notes. Responses arc reported using a 5-point scale. Mean: Implementation Scores: minimal (0.00 1 .50). partial 
( 1 .5 1 - 3.001. substantial (3.01 - 4.50). and/ir// (4.5 1 5.00). Appendix G contains more information about each of 
the core components, supporting components, and indicators used in the measurement of STAR implementation. 
The aggregate implementation scores for 2007-08 arc the averages of schools’ (I) Raising Aeudemii Standards. (2) 
Engaging Teachers and Students, and (3 )Budding School and Community Cultures scores, and do not include scores 
for Increasing Student and Parent Access to Information. 


SUMMARY 


As in previous years. STAR campuses neared substantial levels of implementation in 2010-11; however, 
overall trends suggest that implementation levels arc decreasing as the grant enters its final years. This 
trend is most apparent at the middle school level and suggests that implementation has been less of a 
focus since the lead STAR cohort moved to high school. Although scores at the high school level have 
fluctuated somewhat over STAR’S implementation period, they indicate a largely consistent focus on 
STAR’s college readiness goals. 
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Chapter 10 

STAR Partner Organizations 


GEAR UP funding supports the involvement of partner organizations in grant activities, stressing the role 
of partnerships in increasing community involvement in schools and creating sustainable changes in 
schools and communities. As discussed in chapter 1, four partner organizations supported day-to-day 
implementation efforts in STAR districts during the 2010-1 1 school year. Hicsc partners included ( 1 ) the 
POO at TAMU-CC, (2) the Faculty Fellows mentoring program, (3) the College Board, and (4) FACE. 
TEA selected these partner organizations because they arc focused on improving the college readiness of 
low-income students and engaging communities and parents in education. 

DATA SOURCES 

The following sections describe the role of partner organizations during the 2010-1 1 school year as well 
as partners* plans for supporting the grant in its final year (i.c., 201 1-12). The chapter relics on data 
collected through interviews w ith principals and counselors and focus group discussions with teachers 
conducted as part of site visits to the 12 STAR campuses in spring 201 1. as well as phone interviews with 
representatives of partner organization conducted in summer 2011 . 

PRE-COLLEGE OUTREACH CENTER (POC) AT TEXAS A&M UNIVERSITY-CORPUS 
CHRIST! (TAMU-CC) 

Across grant yean*, the POC at TAMU-CC has provided overarching services to improve GEAR UP 
implementation in each of the six STAR districts. The POC provides ongoing professional development 
to increase academic rigor, disseminates information about GEAR UP sendees and grant requirements, 
and organizes college tours, student leadership activities, and programs helping students transition from 
eighth to ninth grade. The POC also coordinates other partner organizations* services and facilitates the 
Faculty Fellows mentoring program. 

Recognizing the need for more direct "in-distnct* * support for GEAR UP implementation, the POC. in 
collaboration with TEA, created the position of college access coordinator, or CAC. during Year 3 of the 
grant (i.c., 2008-09). CACs are POC staff w ho provide implementation support to individual districts and 
monitor districts* progress toward meeting STAR’S goals and objectives. CACs* offices arc located in 
their assigned districts which enables coordinators to play an active role in day-to-day grant activities. 

In interviews, district staff said they valued the support provided by the POC and CACs. Administrator* 
noted that the POC was responsive to districts* individual needs and alerted staff to opportunities that 
would support individual grants. Administrators said that CACs helped them complete implementation 
plans and coordinate partner activities. CAC’s also assisted w ith grant documentation and reporting 
requirements, facilitated college tours, and encouraged staff, student, and community participation in 
STAR events. "(Our CAC*) has been invaluable in helping our counselors do what they need to do. getting 
our data straight, and making sure we’re communicating,** explained one administrator in spring 2011 . 

The role of C ollege Access Coordinators (CACs). The CAC job description outlines CACs* roles in 
providing support for STAR implementation. I hc description clarifies that CACs serve as collaborative 
partners who support school leadership in planning, coordinating, and monitoring the implementation of 
STAR and in disseminating information about the grant. In interviews, C’ACs highlighted their role in 
entering data in City Span software and generating reports from the system during the 2010-1 1 school 
year. CACs said that they met weekly w ith POC staff throughout the year to discuss districts* progress 
and review implementation reports. In addition to managing data and reviewing reports. CACs said they 





also participated in professional development activities, conducted classroom observations, coordinated 
partner services, ensured communication about STAR activities in other districts, and served as liaisons 
between districts and the POC. Coordinators said their presence ensured greater accountability for 
meeting STAR goals and objectives. As one C'AC noted during a focus group conducted in 2011: 

I think our role is to help the districts understand the goals and objectives, because they have to 
be met... We fCACs] have played a key part in districts being as successful as they are and I 
think every single district (has been successful] and I think that reflects on us and our work. 

CACs said that a central challenge of their jobs during the 2010-1 1 school year was to ensure that districts 
retained a focus on STAR implementation and maintained compliance with grant requirements. CACs 
said that it appeared districts were placing less of a priority on STAR as the grant entered its final years. 
One coordinator explained: 

1 think that since we’re at the end... going into the sixth year of the grant... (STAR] is not so 
important to them [districts] as it was in year one. two. or three. It's a little more difficult to get 
them [district statf| to get what we need and 1 think that has to do with it being the last years of 
the grant. 

FACULTY FELLOWS 

Beginning in Year 2 of the grant (i.c., 2007-08), STAR districts have participated the Faculty Fellows 
mentoring program, which recruits TAMU-CC and TAMU-K college faculty to work in STAR 
classrooms and mentor teachers. Faculty Fellows spend 60 hours each semester working with teachers to 
model engaging classroom instruction, implement AP instructional strategies, and ensure vertical 
alignment. The program's director explained that the goal of Faculty Fellows is to provide a connection to 
college and to improve parents* and students* awareness of the preparation needed to be successful in 
college. As a result of organizational changes at TAMU-CC, the Faculty Fellows program was only 
implemented in the spring of the 2010-1 1 school year, and Faculty Fellows worked primarily in math and 
science. 

In interviews conducted in spring 2011 . teachers were enthusiastic about the program and several school 
administrators expressed a desire to have more Faculty Fellows working on campuses and supporting a 
broader range of subject areas. In one focus group interview, teachers said their Faculty Fellow worked 
with all math teachers at the campus, providing feedback on their instruction and speaking with students 
about college expectations. The Faculty Fellow allowed students to view a syllabus for a college course 
and explained how tests for the course were administered. “It was an eye opener for kids.*’ explained one 
teacher. “Instead of just hearing it from me. they [students) were hearing about [the rigor of college 
courses] from someone who actually docs it.*’ 

Administrators credited the Faculty Fellows program with expanding teachers* resources and improving 
classroom instruction, although several principals noted that Faculty Fellows need to be carefully 
selected, noting that not everyone has the skills to work with middle school or high school students. Some 
administrators also underscored the difficulty of matching the expertise of Faculty Fellows to particular 
subject areas. For example, one middle school struggled to incorporate their Faculty Fellow in classroom 
activities because the Fellow taught physics at the university. Administrators explained that the school 
would have been better served by a Faculty Fellow who taught biology because physics is not taught in 
middle school. 

In addition, to their work on STAR campuses during the school year. Faculty Fellows also supported a 
summer bridge program at TAMU-CC for rising ninth-grade students during the summer of 201 1. The 
bridge program enabled students to attend courses developed by Faculty Fellows to meet their needs 
specifically. Students attended courses from l ) a.m. to l p.m. each day for 2 weeks in the summer. Despite 





extensive preparation for the summer bridge courses, the program was underused by STAR districts 
during the grant's fifth year. While the program had room for 125 students, only 40 students participated 
in summer 2011 . 

THE COLLEGE BOARD 

In previous grant years, the College Board supported STAR through ongoing professional development 
addressing vertical alignment of curricula. AP instructional strategics, and preparation for college testing 
offered to all teachers, including those teaching non-AP courses. During Years 1 through 3 of the grant 
(i.c., 2006-07 through 2008-09), the College Board provided training at workshops held in a central 
location. However, attendance at most workshops was low because of travel requirements, the need for 
substitutes to cover teachers* classes, and the preferences of some district administrators that teachers not 
miss class time. To address these issues, the College Board revised its approach and offered professional 
development during the school day on individual campuses during the grants fourth year (i.c., 2009-10). 
lire goal of this approach was to increase teachers* participation in training; however. College Board 
representatives said attendance remained low because training consultants were unable to schedule time 
when all district teachers were available for training. 

To address the ongoing challenges in providing professional development, in 2010-1 1. the PCX* 
contracted with several independent consultants who provided job-embedded, or in-class, training to 
teachers. Such training included modeling effective strategies in the classroom, observing individual 
teachers* instruction, and offering constructive feedback, as well as training offered during teachcis* 
conference periods. Consultants also worked with counselors to ensure the alignment of counseling 
services across grade levels. 

Although the College Board played a smaller role in STAR professional development activities STAR’S 
fifth year, it continued to support districts* efforts to increase the rigor of instruction and prepare students 
for college. Four STAR districts began using SpringBoard. the College Board's standardized pre-AP 
curriculum, in 2010-1 1, and College Board consultants provided training to support its use. The College 
Board also provided students with access to online SAT prep courses that address test-taking strategics 
and allow* students to take practice exams. 

FATHERS ACTIVE IN COMMUNITIES AND EDUCATION (FACE) 

FACE coordinates activities designed to increase parental involvement in education, and focuses on the 
role of fathers in particular. FACE creates opportunities for parents to form relationships w ith school staff 
and through teambuilding exercises and interactive games that enable parents to connect to the 
curriculum. FACE focuses on four types of activities: ( 1 ) on-campus interactive teambuilding exercises, 
(2) college tours in collaboration with the Faculty Fellows program (3) large inter-district activities, and 
(4) the F ACE father-student Leadership Team. FACE activities generally are offered during the school 
day; however, some campuses, administrators did not allow students to miss classroom instruction to 
participate in activities, which limited FACE’S ability to implement its program. 

Consistent with findings from prior evaluation years, most districts reported that FACE activities were 
more effective with middle school than high school students in 2011. and some districts limited FACE 
participation to middle schools. Administrators said that FACE activities were more appropriate for 
younger students and that middle school parents w ere more likely than high school parents to participate 
in school activities. Administrators also noted that parents who had participated in FACE activities when 
their students were in middle school were not interested in repeating activities when their students were in 
high school. As one principal explained. “FACE is getting old for the parents after so many years of 
having these types of activities, so arc numbers are not as big (as they have been in the past].” 



ONGOING IMPLEMENTATION OF PARTNER SERVICES 


'Ihc 2011-12 school year marks STAR’S sixth and final implementation year and is the year in which the 
lead STAR cohort (i.c., seventh graders in 2006-07) will be in the twelfth grade. As such, the central 
focus of partner activities in 201 1 -12 will be twelfth-grade students with the goal that 100% of twelfth- 
graders graduate prepared for some form of postsecondary education. To reach this goal, TEA worked 
with a production company to create the “STAR Senior Year Plan” — a package of resources for districts 
to use in promoting college planning to twelfth-grade students. Ihc package includes multimedia 
activities and monthly lessons that will guide seniors through the college application process as well as 
ads, posters, and t-shirts that promote college planning. Resources arc designed so that they may be 
tailored to reflect the culture of individual communities and districts. 

As a means to ensure sustainability after the grant ends. STAR partners will train school staff to use 
grant-provided resources and tools. Throughout the 2011-12 implementation year, CACs will work within 
distnets to maintain the focus on STAR goals and ensure that resources arc used effectively. During the 
2011-12 school year, FACE and the Faculty Fellows program plan to work within communities to 
develop partnerships with businesses and local organizations that will provide the financial support 
needed to sustain their services when grant funds expire. 

SUMMARY 

During Year 5. partners focused on building the sustainability of STAR’S initiatives and supported 
distnets in strategic planning and building community support for the program’s goals. Some partner 
representatives reported that the focus on STAR implementation was waning as the grant entered its final 
years and that changes in some district and campus leadership teams also weakened implementation 
efforts. Changes were particularly challenging when new leaders established policies that restricted 
teachers* and students* ability to be out of class, which limited participation in partner activities offered 
during the school day. As a consequence, partners such as the Faculty Fellows mentoring program and 
professional development consultants who worked in classrooms with students and teachers tended to 
experience fewer challenges in providing services. 



Chapter 1 1 
Summary of Findings 


Hie federal GEAR UP grant program provides funding to improve low-income students' readiness for 
and participation in postsecondary educational programs. Grants extend across 6 school years and require 
that participating districts begin providing services to students no later than the seventh grade and that 
services continue until students graduate from high school. GEAR UP operates using a cohort model in 
which services arc provided to all students in participating grade levels, rather than to a selected group of 
students. Texas' state-level GEAR UP grant, known as STAR, began serving seventh-grade students in 
the 2006-07 school year, and has expanded grant serv ices to include additional grade levels as the lead 
seventh-grade cohort has progressed through school. During the 2010-1 1 school year. STAR'S fifth 
implementation year, the lead seventh-grade cohort was in the eleventh grade and STAR services were 
provided to students in Grades 7 through 1 1 . 

The findings presented in this report comprise the fifth-year evaluation of the STAR project. This chapter 
provides a summary of the report's findings, including the characteristics of students participating in 
STAR and performance indicators for STAR schools during the 2010-1 1 school year, as well as 
information about the implementation of STAR and the role of partner organizations. The chapter 
concludes with a discussion of results and the project's ongoing evaluation. 

THE CHARACTERISTICS STUDENTS PARTICIPATING IN STAR AND PERFORMANCE 
INDICATORS FOR STAR SCHOOLS 

The 12 campuses (6 middle schools and 6 high schools) that participate in STAR enroll large proportions 
of Hispanic and low-income students. Of the students included in the STAR cohort (i.e.. Grades 7 through 
11 in 2010-1 1 ). 89% were Hispanic and 75% were from low-income backgrounds. Despite the high 
percentage of Hispanic students participating in STAR, only 2% of cohort students were characterized as 
LEP and only 2% received bilingual or ESL services. Across campuses, the trends in the TAKS passing 
rates*' 1 for students receiving STAR services reflected the trends of peer campuses* and the state as a 
whole. Students in STAR'S first cohort (i.e.. students in Grade 1 1 in 2010-1 1) saw increases in their math 
and reading'ELA passing rates as well as in “all tests taken." However, students in the remaining STAR 
cohorts (i.e.. students in Grades 7 through 10) experienced either no changes or declines in their passing 
rates. State-assigned accountability ratings reflect the lack of growth m TAKS passing rates. Half of 
STAR campuses (four high schools and two middle schools) were rated Academically Unacceptable in 
2010 - 11 . 


' Changes in TAKS passing rates are measured from students' baseline year (Grade 6 TAKS) to the current school 
year (2010-1 1 ). Because STAR serves a range of grade levels the baseline year for each cohort of students will vary. 
For example, the baseline year for the first cohort of students (seventh graders in 2006-07) is 2005-06. while the 
baseline year for the second cohort of students to receive STAR services (seventh graders in 2007-08) is 
2006-07. 

‘ For each campus in the state. TEA has created a peer or comparison group of 40 public school campuses selected 
on the basis of six student demographic characteristics, including the percentages of African American. Hispanic, 
and White students, the percentage of economically disadvantaged students, the percentage of limited English 
proficient students, and the campus mobility rate (2007 Accountability Manual. TEA). For a specific performance 
indicator. TEA reports the median value of the 40 comparison campuses on tlxat indicator. Thus, peer groups allow 
for comparisons of campus performance for similar schools. 
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STAR IMPLEMENTATION 


Recognizing that STAR is unlikely to positively impact students, schools, or communities it' campuses 
minimally or partially implement the program, researchers developed a measurement of STAR 
implementation to support the overarching program evaluation. The analysis measures the extent to which 
STAR schools implement activities and services aligned with the project's four core components: ( 1 > 
Raising Academic Standards. (2) Engaging Teachers and Students , (3) Increasing Student and Parent 
Access to Information . and (4) Building School and Community Cultures that Support Academic 
Achievement. The sections that follow discuss findings for each of the STAR components and its 
associated supporting components. Appendix CJ contains detailed information about the data sources and 
methods used to measure each STAR component and supporting component. 

Raising Academic Standards 

I'he measurement of Raising Academic Standards reflects the extent to which teachers increase 
instructional rigor ( Academic Rigor) and align curriculum ( Curricular Alignment), and the extent to 
which STAR schools engage high school students in advanced coursework (Advanced Academics). On 
average. STAR schools partially implemented instructional and curricular reforms designed to raise 
academic standards during the 2010-1 1 school year, although trends over time indicate increases in 
students' engagement in classroom instruction, as well as in the proportions of high school students 
completing advanced coursework and participating in AP testing. 

Academic Rigor. The measurement of Academic Rigor relies on data collected during classroom 
observations conducted dunng site visits to STAR campuses in the spring of each evaluation year. During 
observations, researchers collect data addressing teachers' use of higher order questioning strategics and 
subject -specific AP strategies, as well as information about the level of student engagement in class 
activities. In spring 201 1. researchers observed decreases in teachers' use of questioning strategies that 
required higher order thinking relative to observations conducted in 2010. In addition, researchers 
observed, on average, fewer subject-specific instructional strategies in all core content areas at the high 
school level and in science and math at the middle school level. Middle school teachers in ELA and social 
studies implemented subject-specific strategies to a greater extent in spring 201 1 relative to the previous 
year. Despite uneven implementation of subject-specific strategies and weaker overall use of higher order 
questioning strategies in 201 1 . students in observed classrooms exhibited greater engagement in 
classroom activities. At the nuddlc school level, students have shown progressively higher levels of 
engagement across STAR'S implementation years. Results at the high school level have fluctuated across 
years, but reached their highest level in 201 1 . 

Curricular Alignment. In 2009-10. College Board and POC training consultants began providing 
monthly, individualized, onsite training at each district high school throughout the school year. This 
approach was continued in 2010-1 1 as a means to ensure that training was tailored to individual campus 
needs. Across districts, training in 2010-1 1 addressed the use of student data to inform decision making, 
strategics to align curriculum and implement effective vertical teams, as well as a range of instructional 
techniques. To measure the effects of these efforts, the evaluation uses indicators related to teachers* use 
of vertical team strategies and participation in vertical team meetings drawn from spring survey data. 
Across implementation years, there has been little variation in the implementation of vertical teams at 
both the middle school and high school levels. On average, teachers report they meet in vertical teams 
once or twice a semester, and middle school teachers tend to meet somewhat more often than high scIkhi! 
teachers. Across years, surveyed teacher* at both levels of schooling have indicated that they sometimes 
use vertical teaming strategics, such as working with peers to develop lessons or observing another 
teachers* instruction, and middle school teachers report somewhat greater use of strategies than high 
school teachers. 



Across evaluation years, teachers participating in surveys and focus group have consistently reported that 
it is difficult to coordinate schedules to accommodate vertical team meetings, particularly when meetings 
include both middle school and high school teachers. In some districts, teachers have encountered 
additional challenges because of policies that limit the amount of time they may work together out of 
class, and teachers in several focus groups have said that the increased use of vertically-aligned curricula, 
such as CSCOPE, has reduced the need for teachers to work in vertical teams. Despite the difficulties of 
meeting as vertical teams, focus group teachers in 201 1 pointed to the value of teams, noting that time 
spent collaborating with colleagues allows them to develop lessons that better prepare students for 
subsequent grade levels and college coursework. 

Advanced Academics. At the high school level, the evaluation measures students* participation in 
advanced coursework using TEA-collocted data on the students' completion of advanced coursework. 
such as AP or dual credit courses, for the previous year/* as well as College Board data documenting the 
proportion of students* who participate in AP testing and earn a score of 3 or higher on AP tests each 
year. (Although policies vary, most colleges award credit for AP test scores of 3 or higher.) 

Advanced coursework. STAR establishes the goal that 50% of high school students will participate in 
advanced courses, and while high schools fell short of this goal in 2010 - 11 . they have demonstrated 
substantial progress in improving advanced course completion rates over the grant's implementation 
period. About 14% of students in STAR high schools completed advanced courses in 2006-07 (the grant's 
first year). In 2009-10, however, nearly 20% of students completed advanced courses — an increase of 
more than 40%. This trend is expected to continue as the lead STAR cohort (seventh graders in 2006-07) 
moves into their final years of high school because many advanced courses arc limited to students in the 
eleventh and twelfth grades. 

AP exam participation. In addition. STAR high schools have seen dramatic increases in the proportions of 
students who participate in AP testing. STAR sets goals for participation in AP testing relative to the state 
average reported in AEIS. and asks that schools meet or exceed the state average by the project's fifth 
year. This report's findings indicate that ST AR high schools met this goal in the grant's fourth year (i.c.. 
2009-10) and continued to improve participation rates in its fifth year (i.c.. 2010-1 1). In the grant's first 
year (i.c., 2006-07) about 9% of students in STAR high schools participated in AP testing relative to the 
state rate of 10%. In STAR'S fourth year 16% of students at STAR high schools participated in testing 
relative to the state rate of about 13%, and in 2010-1 1 (Year 5). about 19% of students in STAR high 
schools took AP tests relative to the state rate of 14%. Across project years. STAR high schools have 
increased percentage of students participating in AP testing by more than 100%. Although state-level 
trends across this period also reflect an increase in the percentage of students taking AP tests, the 
percentage increase for the state is only 40%. 

AP exam scores. Despite increases in the percentages of students taking advanced coursework and 
participating in AP testing. STAR high schools have not achieved similar gains in the percentage of tested 
students earning a score of 3 or higher on AP exams. In the grant's first year, about 8% of students in 
STAR high schools who took AP tests earned a score of 3 or higher, but by its fifth year, only 5% of 
students earned such a score (see fable 1.4 in Appendix I). This result suggests that STAR high schools 
have been successful in encouraging students to enroll in AP courses and participate in testing, but they 
have not provided students with the level of academic preparation necessary to be awarded college credit 
for AP courses. 


~TF.A Course Completion data are lagged a year, so tlw most current data tor any given evaluation year ate for the 
preceding year. For example, that analyses used for the Year 5 evaluation (2010-1 1 1 rely on data for the 2009-10 
school year. 
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Engaging Teachers and Students 


A second component of STAR implementation is the degree to which teachers and students arc engaged 
in achieving program goals. The evaluation considers ( I ) teacher engagement in STAR professional 
development opportunities and (2) student engagement in activities that address STAR goals, as well as 
their attendance rates in measuring this component. Overall, STAR campuses substantially engaged 
teachers and students in the project’s fifth year, although scores for this component declined in 2010-1 1 
relative to previous evaluation years. 

Teacher Engagement in Professional Development. Data used to measure teachers* participation in 
professional development activities are drawn from surv eys administered teachers in the spring of each 
evaluation year. The surveys ask a range of questions about the training teachers receive, including 
whether they have had sufficient training to implement AP strategics and use data to plan instruction, as 
well as whether they are encouraged to use new instructional strategics. Across evaluation years, teachers 
have consistently reported high levels of engagement in professional development, although survey 
responses in 2010-1 1 reflected a small decrease at the high school level. In interviews, some teachers said 
that STAR was receiving less emphasis as it entered its final years, which may partly explain the decline 
in teachers’ engagement. As teachers in one focus group noted. “(We) haven’t seen as much (emphasis on 
STAR) this year.” 

Student Engagement in Schooling. The evaluation uses student survey data and REIMS attendance data 
to measure students* engagement in their schools. The student surveys ask respondents to identify the 
types of activities they participate in each year, including tutoring, counseling, and STAR partner 
activities, such as FACE events or Faculty Fellows instruction. Similar to results for teachers. STAR 
campuses have had high levels of student engagement across evaluation years, but scores declined 
somewhat in 2010-1 1. particularly at the middle school level. As noted in the previous section, this 
finding is likely related to a reduced focus on STAR implementation as the grant enters its last years. 
Results for middle schools also suggest that STAR has received less attention since its lead cohort 
(seventh graders in 2006-07) moved to high school. 

Increasing Student and Parent Access to Information 

In order to increase academic achievement and develop college-going cultures among low-income 
students and their families. STAR provides increased access to informational resources about 
postsecondary educational opportunities. STAR resources arc designed to improve parents’ and students' 
ability to plan and prepare for long-term educational goals. The evaluation measures this component of 
STAR — Increasing Student and Parent Access to Information — by examining two supporting 
components: STAR campus* implementation of services that provide informational resources to ( 1) 
students ( Student Access to Information) and (2) parents {Parent Access to Information). 

Students' Access to Information. This component of STAR is measured using information collected 
through surveys that ask about students’ familiarity with a variety of postsecondary educational 
opportunities, entrance requirements, and financial aid options, as well as students* participation in 
activities, such as college visits, career fairs, and summer programs, that are focused on improving their 
understanding of postsecondary education. Across years. STAR campuses have provided students with 
access to information that approached substantial levels: however, results for 2010-1 1 mark a decline 
from the levels observed in previous years, particularly at middle schools. Proportionately, fewer middle 
school students reported familiarity with postsecondary opportunities, such as 4-year colleges, community 
colleges, and vocational/technical schools. Middle school students’ awareness of college entrance 
requirements and financial aid also declined. In contrast, these measures generally increased at the high 
school level. Similar to results presented in the previous section, this finding suggests that STAR 
implementation has decreased at middle schools. 


100 



Parents' Access to Information. Data from the parent and staff surveys are used to measure Parents * 
Access to Information. The teacher survey asks respondents about parents' level of involvement in school 
activities, and the parent survey asks about parents participation in a range of school and home-based 
activities focused on educational goals. Across years, the evaluation has found that parents have had 
partial access to information, and results for 2010-1 1 indicate that both high school and middle school 
parents had less access to information than in previous grant years. Less than a third of surveyed parents 
reported receiving information about college planning topics from their students* school in 2010 - 1 1 , 
although most parents said they talked to their students about college planning and provided support for 
academic goals. 

Building School and Community Cultures That Support Academic Achievement 

STAR campuses arc expected to develop environments that foster postsecondary goals and to engage 
parents and the larger community in supporting the schools* college-going cultures. In measuring school 
and community support for STAR, the evaluation considers the School Environment of STAR campuses, 
including staff buy-in to project goals and support for innovation, as well as Parent and Community 
Support of students* academic goals. 

STAR School Environments. 'Ihc School Environment indicator is measured using data from surveys of 
staff on STAR campuses, and across grant years results for both middle schools and high schools have 
indicated substantial levels of buy-in and support for STAR. Despite considerable administrative turnover 
in some districts, staffs on STAR campuses have generally agreed that school leaders support grant goals, 
foster buy-in among staff, and encourage innovation in instruction. 

Parent and Community Support. Ihc level of Parent and Community Support for students* academic 
goals incorporates results from the spring surv eys of parents and school staff. Across STAR 
implementation years, school staff have consistently agreed that parents and the larger community are 
engaged in school activities; however, results from the parent survey suggest that parents* participation in 
school activ ities has been lower in the 2009-10 and 2010-1 1 school years than in previous grant years. In 
interviews, school administrators highlighted the challenge of increasing parents* engagement in school 
activities and raising their expectations for students* academic outcomes, noting that some parents were 
resistant to schools* efforts to engage students in ngorous coursework. 

STAR PARTNER ORGANIZATIONS 

Ihc STAR project includes partnerships with organizations that provide services aligned with GEAR 
UP*s mission and goals. For the 2010-1 1 school year. STAR partner organizations included ( I ) the POC* 
at TAMU-CC. (2) the Faculty Fellows mentoring program. (3) the College Board, and (4) FACE. The 
POC at TAMU-CC* supports districts* implementation of GEAR UP by assisting with grant planning, 
providing information sessions and training, and coordinating grant activities with the university. Faculty 
Fellows provide mentoring services to secondary educators and model engaging instruction in the 
classroom. The College Board offers district staff professional development designed to support vertical 
alignment of districts' cumcula and improv e classroom instruction. FACE coordinates activities designed 
to increase fathers* involvement in their child's education through positive interactions and teambuilding 
exercises. 

In 2010-1 1. partner organizations focused on building capacity to sustain STAR'S focus on college 
readiness once grant funds expire in 2012. To this end. partners worked with district staff to develop 
sustainability plans and provide training in the use of student data to inform decision making. Leadership 
changes in some districts created challenges for partners whose services are delivered outside of the 
classroom setting when new administrators limited the amount of time students* and teachers* spent in 
activities outside of class. 
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DISCUSSION 


Across most indicators, measures of STAR implementation declined in 2010-11, and declines were most 
notable at middle schools. For sonic indicators, declines at the middle school started when the lead STAR 
cohort moved to high school for the 20084)9 school year. This result suggests that middle schools 
reduced their focus on STAR implementation when grant resources were spread across middle school and 
high school students. The overall declining trend at both levels of schooling also points to implementation 
fatigue. In interviews, school staff said that there was less of an emphasis on STAR in 2010-1 1 than in 
previous years, and project partners highlighted the challenge of keeping districts focused on 
implementation as the grant entered its final years. 

While most indicators of implementation declined in 2010-1 1. STAR high schools continued to increase 
the numbers of students who participate in AP courscwork and testing. Across grant years. STAR high 
schools have increased the percentage of students participating in advanced courses by 40% and increased 
the percentage of students participating in AP testing by more than 100%. This trend is expected to 
continue in 201 1-12 as the lead STAR cohort enters the twelfth grade. Although STAR high schools have 
been successful in improving students' participation in advanced courses and AP testing, they have not 
seen a corresponding increase in the percentage of students earning an AP test score of 3 or better. This 
suggests that STAR schools arc not yet providing the level of instructional rigor needed to prepare 
students to be successful in college courscwork. 

THE ONGOING EVALUATION 

The evaluation of SPAR will continue through the grant's final year (i.c.. 2011-12). During the 201 1-12 
school year, the lead STAR cohort (i.c., seventh gradcis in 20064)7) will be in the twelfth grade and 
participating high schools will focus more intensely on activities designed to engage students and their 
parents in applying to postsecondary educational programs. The evaluation will focus on how these 
efforts may affect students* participation in postsecondary programs as well as how the full six-year 
implementation of STAR has shaped school and community cultures. In addition, the evaluation will 
consider the ongoing challenges districts encountered in improving the college readiness of students and 
the strategies they implemented to overcome challenges. 
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Appendix A 

Results from the Spring 201 1 Teacher, Counselor, Librarian Survey 


Table A.l. Number of Respondents (Teachers* Counselors. Librarians ) by School 



Number in 

Number 


District/School 

Database 

Completed 

Response Rate 

Alice ISO 




Adams Middle School 

M 

62 

96.8% 

Alice High Schcxil 

120 

114 

95.0% 

Brooks County ISD 

Fal fumas Junior High 

28 

28 

100.0% 

Falfumas High School 

35 

35 

100.0% 

Corpus Christi ISD 

Driscoll Middle School 

43 

43 

100.0% 

Miller High School 

95 

95 

ltx>. 0 % 

Kingsville ISD 

Memorial Middle School 39 

m t i 1/ iiii'i i in 

39 100.0% 

/A n ti r tv 

n. ivi. nign acnooi 

Mathis ISD 

/ft 

ov 

ftft.;r*r 

athis Middle School 

21 

«/» 

21 

100.0% 

CfY 

Mathis Hi eh he hex)! 

Odem-Edroy ISD 


37 


Odcm Junior High 

21 

21 

HM1.0% 

Odcm High School 

30 

26 

86.7% 

Total 

615 

590 

95.9% 


Sou ret: STAR Teacher. Counselor, and Librarian Survey, spring 201 1. 


Table A.2. Indicate the Position in Which You Currently Work 



Faltumas Junior High 


Adams Middle School 
H. M. King High School 
Memorial Middle School 
Miller High School 
Driscoll Middle School 
Mathis High School 
Mathis Middle School 
Odcm High School 


Source: STAR Teacher. Counselor, and Librarian Survey 
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Table A. 3. Grade Lewis Respondents Work With 



1 — 

ri ri r*\ r- 

— CC 

LJ 

> c r- 































Table A. 4. If You Area Teacher. What Is Your Primary Teaching Assignment? 



K» 




Table A.5. Years Employed in This Position and Years Working at This School 



Years Employed in 
Current Position 

Years Employed in 
Current Position at This 
School 

Campus 

N 

Mean 

N 

Mean 

Falfurrias High School 1 

35 ~| 

13.5 1 

35 | 

•Ml 

ft 1 lumas Junior High 

28 

TO 

28 

8.4 

Alice High School i 

113 

11.4 1 

1 14 j 

72 

Adams Middle School 1 

62 

8.3 1 

61 

5.5 

H. M. King High School 

69 | 

10.9 

69 1 

o 

Memorial Middle School 

39 I 

1 1.8 

39 J 

7.1 

Miller High School j 

95 | 

8.8 

95 1 

5.8 

Driscoll Middle School j 

43 1 

10.8 1 

43 1 

7.3 

Mathis High School | 

37 

10.8 ] 

37 | 

4.5 

Mathis Middle School I 

21 

9.9 I 

21 1 

T5 

Odcm High School ] 

26 

13.9 | 

26 j 

6.7 

Odcm Junior High 

21 1 

9.4 

21 

4.6 

Total 

589 

10.6 

589 

6.7 


Source: STAR Teacher. Counselor, and Libraiian Survey, spring 201 1. 


Table A.6. Ethnicity of Respondents 


Campus 

Alncan 

Amcncan 

Hispanic. 

Latino 

White. Anglo 

Other 

Falfurrias High School (N=35) 

2.9% 

82.9% 

11.4% 

2.9% 

Falfurrias Junior High (N=28i 

0.0% | 

82.1% | 

17.9% | 

0.0% 

Alice High School (N= 114) | 

0.9% | 

58.6% 

38.7% 

1.8% 

Adams Middle School (N=62> 

32% | 

54,8% 

38.7% 

3.2% 

H. M. King High School (N=69)H 

4.3% | 

62.3% 

24.6% 

8.7% 

Memorial Middle School <N=39TJ 

0.0% 

71.8% 

23.1% 1 

5.1% 

Miller High School i N=95 ) 

7.4% 

51.6% 

36.8% 

4.2% 

Driscoll Middle School (N=43) 

7.0% 

55.8% 

34.9% 

2.3% 

Mathis High Schoori N=37) | 

0,0% | 

54,1% | 

40.5% j 

5.4% 

Mathis Middle School (N=2 1) 

0.0% 

57.1% 

38.1% 

478% 

Odcm High School «N=26[ 

3.8% 

42.3% | 

46.2% 

7.7% 

Odem Junior High(N=21| | 

0,0% 

57.1% 

42.9% 

0.0% 

All Campuses <N=590( 

3.1% 

59.6% 

33.4% 

3.9% 


Source: STAR Teacher. Counselor, and Libraiian Survey, spring 201 1. 






Table A.7. Grader of Respondents 


1 Campus 

Male 

Female 1 

*- ■ ■ - ■ ■ ■ - ■ i. - i 1 

Falfurrias High School (N=35) 

34.3% 

65.7% 

Falt'urrias Junioi High )N=28| | 

25.0% 

75.0% 

Alice High School <N= 1 Hi 1 

39.3% 

60J% 

Adams Middle School <N=62> 

24.2% 

75.8% 

H. M. King High School (N=69) 

42.0% 

58.0% 

Memorial Middle School (N=39) 

34.2% 

6578% 

Miller High Schoof|N=9S) | 

54.7% 

45.3% 

Driscoll Middle School IN=43) 

14.0% 

86.0% 

Mathis High School (N=37) 1 

43.2% 

56.8% 

Mathis Middle School (N=2I) 

33.3% 

66.7% 

Odem High School <N=26i 

34.6% 

65.4% 

Odeni Junior High <N=2I ) 

38.1% 

61.9% 

All C ampuses (N=590> 

37.1% 

62.9% 


Sonn e: STAR Teacher. Coun&cloi. and Ltbraiiun Survey, spring 201 1. 





Table A.8. What Is Your Highest Educational Attainment? 
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Tabic A.9. Extent of Agreement With Each of the Following Statements (Continued) 



£ 4 R 3? 5! R K 5 


b S S $ $ Z £ 
2 R R 2 2 


£,'£££ 2 £ £ £ £ £ 
:? 8SS?, g 3 


^ - -t ^ ^ u-; 


-5 1/5 

e« O 


Table continues 

















































































































































































1 15 


























































































g £ £ £ £ £ £ £ S 
3 ?: 4 4 4 K V a 


2? £ 2? 3? Ei 3 £ 2 £ s 4 


n *> -t « ^i -c ^*1 ^ t 

«£ 2 R = S!a 2 :^a 


^ W <-i K © h© 30 © d 


i ill 111! 


116 


Tabfc continues 












































































































































Tabfc continues 




















































































































































Tabic A.9. Extent of Agreement With Each of the Following Statements (Continued) 




118 


Survey, spring 2011. 
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Tabic A. 10. How Often Do You Provide Students With Counseling or Advice About the Following? (Continued) 
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Table continues 










































































































































Tabic A. 1 1 . How Often Do You Provide Parents With Counseling or Advice About the Following? (Continued) 

Post -secondary financial aid, scholarships, or college 
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Source: STAR Tcxher Counselor, and Librarian Survey, spring 201 1 , 































































































































































































Tabic A. 12. Responses to Statements Regarding Vertical Teams 
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Tabic A. 15. Rank the Importance of Each Counseling Task (Counselor Only | (Continued) 

Providing parents with support and seiv ices 
Between Least Between Neutral 
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Tabic A. 16 . Mean Percentage of Time Spent on Specific Counseling Tasks (Counselors Only) 

Falfumas Alice High H. M. King Miller 
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Table A.I7. About How Often Do You Interact With Colleagues in Each of the Following Ways? (Teachers Only) (Continued) 

Work with a subjcct-aica pecr(s) on my campus to Work with a subjcct-aica pccrfs) from a fc 

de velop a lesson plan or class activity campus to develop a lesson plan or clas 
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Table A. 18 . a. Responses to Statements Regarding Advanced Placement (Teachers Only) 
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Table A. 19. Responses lo Statements Regarding Faculty Fellows (Teachers Only) 
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UP (STAR) Teacher. Counselor. and Librarian Survey, spring 201 1 . 















































































Table A.21. How Useful Were Any Lectures, Presentations, or Demonstrations Given by a 
University Faculty Fellow in Your Class? (Only Teachers Assigned a Faculty Fellow) 


Campus 

Very useful 

Somewhat 

useful 

Not very 
useful 

My Faculty Fellow 
did not give a 
lecture/ 
presentation/ 
demonstration 

Falfumas High School | 

50.0'* 

33.3% 

0.0% 

1 6.7% 

Falfumas Junior High 

20.0% 

60.0% 

20.0% 

0.0% 

Alice High School 

20.0% 

20.0% 

0.0% 

60.0% 

Adams Middle School 

0.0% 

33.3% 

0.0% 

66.7% 

H. M. King High School 

IIS'T 

62.5% 

Tl5¥ 

12.5% 

Memorial Middle School 

25.0% 

75.0% 

0.0% 

0.0% 

Miller High School 

20.0% 

20.0% 

0.0% 

60.0% 

Driscoll Middle School 

50.0% 

0.0% 

0.0% 

50.0% 

Malhis High School 

100.0% 

0.0% 

0.0% 

0.0% 

Mathis Middle School ] 

25.0% 

25.0% 

0.0% 

50.0% 

(Mem High School I 

66.7% 

33.3% 

6.0% 

0.0% 

Odcm Junior High 1 

100.0% 

0.0% 

0.0% 

0.0% 

All Campuses 

35.1% 

36.8% 

3.5% 

24.6% 


Source: GEAR UP (STAR) Teacher. Counselor, and Librarian Survey, spiing 201 1 . 
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Appendix B 

Results from the Spring 2011 Parent Survey 


Tabic B.l. Which of the Following School Activities Have You Participated 
in Over the Course of the Past School Year? 


PTA/PTO meeting 
Yes No 


Campus 

N 


■ 

Falfumas High School 

10 

22 . 1 % 

34 

77.3% 

Falfurnas Junior High 

6 

26.1% 

17 

73.9% 

Alice High School 

16 

20.8% 

61 

79.2% 

Adams Middle School 

37 

47.4% 

41 

52.6% 

H. M. King High School 

9 

8.7% 

94 

91.3% 

Memorial Middle School 

II 

20.4% 

43 

79.6% 

Miller High School 

27 

28.7% 

67 

71.3% 

Driscoll Middle School 

24 

58.5% 

17 

41.5% 

Mathis High School 

12 

25.0% 

36 

75.0% 

Mathis Middle School 

5 

21.7% 

18 

78.3% 

Odem High School 

2 

8.0% 

23 

92.0% 

Odem Junior High 

4 

25.0% 

12 

75.0% 

All Campuses 

163 

26.0% 

463 

74.0% 


Table continues 
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Table B J. How Familiar Are You with the GEAR UP/STAR Program at Your Child's School? 

Not familiar at all Not very fa mi liar Somewhat familiar 5 





112 





Math In M iddlc Sc hool 9 39.1% 8 34,8* 4 17.4% 2 8.7% 

Ode m High School 11 44 o 7 28.0'S 5 2Q.0S 2 S.<v, 

Odem Junior High 3 18.8% 2 I." . 5 31.3% 6 37.5% 

All Campuses 299 47.8% 136 21.7% 124 19,8% 67 10.7% 

Table continue* 
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Table Bi. Has Your Child Expressed an Interest in Going to College? 



r- t- © r- oo 


Source: GEAR UP (STAR) Patent Survey, spring 201 I . 






























Table B.7. How Often Do You Do Each of the Following with Your Child? (Continued) 

Talk about financial aid opportunities, scholarships, and other resources 
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Source : GEAR UP<STAR)Parenl Survey, spring 201 1. 



Table B. 12. Have You Received any Info mi at ion from Your Child's School About the (iraduation Han 
Called the Recommended High School Program in Texas? (Parents of High School Students Only) 

Don’t know oi declined to 
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Source: GEAR UP (STAR) Parent Survey, spring 201 I 










Table BJ7. What is the Primary Language Spoken in Your Home? 




yo & O' -t f ^ r+ — 

n — r*> sT'. <C r^. ri r*\ — r| 
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: GEAR UP (STAR) Parent Survey. 


































Table B.19. I low many years haw you lived at your current address? 

Mow many y ears have you lived at your 
current address? 

Campus Av erage years 

Falturrias High School 1 6. 1 
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Ul’ (STAR) Parent Survey, spring 201 I . 













Tabic B.21. How Many Years of Formal Schooling Have 
You Completed? 


Campus 

Falfurrias High School 

Average number of years 
11.9 

Falfurrias Junior High 

11.6 

Alice High School 

11.9 

Adams Middle School 

12.1 

H. M. King High School 

11.9 

Memorial Middle School 

12.1 

Miller High School 

10.0 

Driscoll Middle School 

10.5 

Mathis High School 

11. 1 

Mathis Middle School 

11.7 

Odcni High School 

12.2 

Odcm Junior High 

9.8 

All Campuses 

11.4 


Source: GEAR UP (STAR) Parent Survey, spring 2011. 

Table B.22. Have You Attended College? 


Yes 

Campus N 


Falfurrias High School 

21 

47.7% 

23 

52.3% 


0.0% 

Falfutrias Junior High 

13 

56.554 

10 

43.5% 

HKJH 

0.0% 

Alice High School 

41 

53.2% 

36 

46.854- 

ESKlIHii 

0.0% 

Adams Middle School 

54 

69.2% 

24 

30.8% 


0.0% 

H.M. King High School 

63 

61.2% 

39 

37.9% 

i 

1.0% 

Memorial Middle School 

29 

53.7% 

24 

44.4% 

i 

1.9% 

Miller High School 

26 

27.7% 

68 

72.3% 


0.0% 

Driscoll Middle School 

15 

36.6% 

26 

63.4% 


0.0% 

Mathis High School 

19 

39.6% 

28 

58.3% 

i 

2.1% 

Mathis Middle School 

II 

47.8% 

II 

47.8% 

i 

4.3% 

(Went High School 

14 

56.0% 

II 

44.0% 


0.0% 

(Went Junior High 

7 

43.8% 

9 

56.3% 


0.0% 

All Campuses 

313 

50.0% 

309 

49.4% 

4 

0.6% 


Source: GEAR UP (STAR) Paient Survey, spring 2011. 
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Table B.23. How Many Years of College Have You 
Completed? (Only Respondents Who Answered Yes to 
Attending College) 


Campus 

Average number of years 

Falfurrias High School 

7 7 

Falfurrias Junior High 

1.5 

Alice High School 

7 7 

Ad ants Middle School 

2.4 

H. M. King High School 
Memorial Middle School 

3.0 
3 4 

Miller High School 

1.7 

Driscoll Middle School 

2.3 

Mathis High School 

"> *7 

Mathis Middle School 

2.5 

Odcrn High School 

3.3 

Odcm Junior High 2.4 

All Campuses 

2.5 


Source. GEAR UP (STAR) Parent Survey, spring 2011. 









Appendix C 

Results from the Spring 201 1 Middle School Student Survey 


Tabic Cl. Number of Middle School Students Responding by District and School 


Campus 

Number of 
Students 

Surveys 

Received 

Response Rate 

Brooks County ISD 

Falfumas Junior High 

! 229 i 

153 

67% 

Alice ISD 

Adams Middle School 

830 

554 

67% 

Kingsville ISD 

Memorial Middle School 

) 508 

43S 

1 86% 

Corpus Christi ISD 

iVicrvvIl Mi/LIL, L'rKnrvI 



*7 Vft 

un Stoll .Middle acnooi 

Mathis ISD 

4 1 J 

3 In 


Mathis Middle School 

214 

182 

85% 

Odem-Edroy ISD 

Odcm Junior High 

171 

151 

88% 

AH Campuses 

2.365 

1.801 

76% 


Source: STAR Middle School Siudeni Survey, spring 2011. 
Wore. Number of student' based on AE1S 2009*10 counts. 


Table C.2. Prior Year Enrollment Status of Students Responding to the Middle 
School Survey 



Yes 

No 

< ’ampus 

N 

% 

N 

% 

Falfumas Junior High 

130 

85.5% 

22 1 

14.5% 

Adams Middle School 

248 

45.3% 

300 | 

54.7% 

Memorial Middle School 

239 

5478% 

197 1 

45.2% 

Driscoll Middle School j 

280 

87.5% 

40 

12.5% 

Mathis Middle School j 

148 

82.2% 

32 1 

17.8% 

Odcm Junior High 

122 

81.9% 

27 

18.1% 

All Campuses 

1.167 

65.4% 

618 

34.6% 


Source: STAR Middle School Student Survey, spring 2011. 


Table C.3. tirade Levels of Students Responding to the Middle School Survey 


7 8 


Campus 

N 

nc 

% 
'ICi Act 

N 

no 

% 

C 1 Aff 

l-jltumas Junior rlign 
Adams Middle School 1 

O 

324 

58.9% 

/o 

222 

.j 1 .Uw 
40.4% 

Memorial Middle School 

217 

50.0% 

215 

49.5% 

Driscoll Middle School | 

169 

52.2% 

153 

47.2% 

Mathis Middle School j 

84 

46.4% 

“97 

53.6% 

Odcm Junior High 1 

78 

52.0% 

72 

48.0% 

All Campuses 

947 

52.8% 

837 

46.7% 


Source: STAR Middle School Student Survey, spiing 2011. 
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Table C.4. (lender of Students Responding to the Middle School Survey 


Male Female 


Campus 

N 

% 

N 

% 

Fallurnas Junior High 

84 

55.6% 

67 

44.4% 

Adams Middle School 1 

273 

49.9% 

274 

50.1% 

Memorial Middle School 

219 

50.2% 

217 

49.8% 

Dnscoll Middle School 1 

159 

49.8% 

160 1 

50.2% 

Mathis Middle School | 

86 

47.5% 

95 

52.5% 

Odcni Junior High 

65 

43.3% 

85 

56.7% 

All Campuses 

886 

49.7% 

898 

50.3% 


Source. STAR Middle School Student Survey, spring 2011. 


Table C.5. Kthnicitv of Students Respondin’: to the Middle School Survey 



Hispanic. Latino 

African 

American 

White 

Other 

Campus 

N 

% 

n j 

% 

N 

% 

N 

% 

Fallurnas Junior High i 

145 

95.4% 

2 

1.3% 

3 | 

2.0% 

2 

1.3% 

Adams Middle School 

487 

88.4% 

6 

1.1% 

44 1 

8.0% 

14 

2.5% 

Memorial Middle Stfhool 

357 

8 1.9% 

^23 

5.3% 

39 

8.9% 


3.9% 

Driscoll Middle School 

271 

84.2% 

27 

8.4% 

13 

4.0% 

ii 

3.4% 

Mathis Middle School i 

167 

91.8% 

~ 3 

1.6% 

10 1 

5.5% 


1.1% 

Odem Junior High 

119 

79.9% 

0 

0.0% 

77 1 

14.8% 

8 

5.4% 

All Campuses 

1.546 

86.3% 

61 

3.4% 

131 

7.3% 

54 

3.0% 


Source. STAR Middle School Student Survey, spring 2011. 


162 






Table C.6. How Much Time Do You Usually Spend on Homework Each Day? 
I Less than 30 
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Table C.7. Which of the Fallowing Courses or Programs Are You Enrolled in This Year? (Continued) 

Enrolled in other math course this Enrolled in gi tted and ta 

Enrolled i n geometry this year year piugram this year 



Kvt 
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Mathis Middle School 28 15.6% 152 84.4% IIP 61.5% 69 38.5% 102 56.0% 80 44.0% 

Odem Junior High 25 16.8% 124 83.2%~ 92 63.4% 53 36.6ft— 1 16 78.9% 31 21.1% 

All Campuses 1 233 1 13.1% 1,543 86.9ft 704 40.2ft 1,047 59.8% 968 54.5 ft 808 45.5'- 

Tablc continue? 
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Table CM2. Has Anyone Talked to You About College Entrance Requirements? 
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Source: STAR Middle School Sludcni Survey, spring 201 I . 







Appendix D 

Results From the Spring 201 1 High School Student Survey 


Tabic I).l. Number of High School Students Responding by District and School 


Campus 

Brooks County ISD 

Number of 
Students 

Surveys 

Received 

Response Rate 

Falfurrias High School 

Alice ISD 

I 422 

221 

| 52% 

Alice High School 

1.354 i 

633 

47% 

Kingsville ISD 

1 /IV 1 

Tic 


H. vi. King mgn acnooi 

Corpus Christi ISD 

1 ,Uo4 


yj x 

Miller High School 

914 

549 

60% 

MiwaiSD 

Mathis High School 

479 

335 

70% 

1 Odem-Edroy ISD 

Odcm High School 

303 

209 

69% 

All Campuses 

4.556 

2,372 

52% 


Source: STAR High School Student Survey, spring 2011. 
Nine. Number of students based on AEIS 2009-10 counts. 


Table D.2. Prior Vear Enrollment Status of Students Responding to the 
High School Survey 


Y'cs No 


Campus 

N 

% 

N 

% 

Falfurrias High School 

146 

67.3% 

71 

32.7% 

Alice High School 

442 

70.3% 

187 

29.7% 

H. M. King High School 

255 

60.0% 

170 

40.0% 

Miller High School 

399 

72.9% 

148 ] 

27.1% 

Mathis High School | 

240 

71.9% 

94 

28.1% 

Odcm High School j 

163 

78.4% 

45 | 

21.6% 

All Campuses 

1.645 

69.7% 

715 

30.3% 


Source: STAR High School Student Survey, spring 2011. 


Table DJ. tirade Levels of Students Responding to the High School Survey 




9 


10 


11 


12 

Campus 

N 

% 

N 

% 

N 

% 

N 

% 

Falfurrias High School 

65 

[29.7% 

61 

J 27.9% 

49 

22.4% 

44 

1 20.1% 

Alice High School 

167 

26 4‘t 

259 

41.0% 

97 

15.3% 

109 

17.2% 

H. M. King High School 

195 

45.9% 

98 

1 23.1% 

93 

21.9% 

39 

9.2% 

Miller High School i 

153 

| 27.9% 

145 

26.4% 

102 

18.6% 

149 

1 27.1% 

Mathis High School j 

76 

22l% 

100 

29.9% 

95 

28.4% 

63 

18.9% 

Odcm High School j 

61 

29.3% 

73 

35.1% 

40 

19.2% 

34 

16.3% 

All Campuses 

717 30.3% 

736 

31.1% 

476 20.1% 

438 

1 18.5% 


Source: STAR High School Student Survey, spring 2011. 











Table D.4. Gender of Students Responding to the High School Survey 


Male Female 


Campus 

N 

% 

N 

% 

Falfunias High School 

% 

44.2% 

121 

55.8% 

Alice High School 

316 

50.2% 

314 

49.8% 

H. M. King High School 

219 

51.7% 

205 

48.3% 

Miller High School j 

281 

51.7% 

263 

48.3% 

Mathis High School | 

m 

51.4% 

162 

48.6% 

Odcm High School 

113 

54.0% 

93 

45.1% 

All Campuses 

1,196 

50.8% 

1.158 

49.2% 


Source: STAR High School Student Survey, spring 2011. 


Table I).5. Ethnicity of Students Responding to the High School Survey 



Hispanic. Latino 

African 

American 

White 

Other 

Campus 

N % 

N 

% 

N 

% 

N 

% 

Falfunias High School 

206 94.1% 

0 

0.0% 

10 

4.6% 

3 

i.4% 

Alice High School 

565 j 89.5% 


1.1% 

51 

8.1% 

8 

1.3% 

H. M. King High School J 

344 j 81.1% 

14 

3.3% 

49 

11.6% 

17 

4.0% 

Miller High School i 

463 85.0% 

40 

7.3% 

23 

4.2% 

19 

3.5% 

Mathis High School j 

288 86.0% 

3 

0.9% 

32 

9.6% 

12 

3.6% 

Odcm High School 

165 79.3% ~ 

1 

0.5% 

31 

14.9% 

II 

5.3% 

All Campuses 

2.031 86.0% i 

65 

2.8% 

196 

8.3% 

70 

3.0% 


Source: STAR High School Student Survey, spring 2011. 


Table D.6. How Much Time Do You Usually Spend on Homework Each Day? 



Less than 30 
minutes 

30 to 59 
minutes 

1 to 2 hours 

More than 2 
hours 

My teacher 
docs not 
assign 
homework. 

Campus 

N % 

N 

% 

N 

% 

N | % 

N 

% 

Falfunias High School 

99 46.7%~| 

69 1 

32.5% 

28 1 

13.2% 

6 2.8% 

10 

4.7% 

Alice High School 

275 44.4% 

169 

27.3% 

49 1 

7.9% 

12 1.9% 

114 

18.4% 

H. M. King High School 

186 44.4% 1 

149 

35.6% 

35 j 

874% 

10 2.4% 

39 

9.3% 

Miller High School 
Mathis Hit'll School 

217 40.4% 
165 50 9% 1 

150 

85 

27,9% 
’6 ’% 1 

44 
34 1 

872% 
10 5% 

16 3.0% 

4 [ 1.2% 
4 2.0% 

no 

36 

20.5% 

1 1 i • : 

iVlUVIll.v 1 II eJVII\IV/l 

Odcm High School j 

75 73676%! 

| 

93 

45.4% 

jlj 

a w../ t\> 1 

5.9% [ 

1 I 

I 21 

10.2% 

All Campuses 

1.017 43.9% | 

715 

30.9% i 

202[ 

8.7% 

52 2.2% 

330 

14.2% 


Source: STAR High School Student Survey, spring 201 1 . 
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Tabic I). 11. Has Anyone Talked to You About College Entrance Requirements? 

A GEAR UP. STAR representative My parcnt(s) or guardian My school counselor 
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Pont know [ 24 1 1 1.7% | SO 13.1% | 46 11,4% | 73 14.2% | 25 7.6% | 25 12.5% ] 273 12.1% 

Source: STAR High School Student Survey, spring 2011. 
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Appendix E 

Instruments and Protocols 


surveys 

Teacher, Counselor, and Librarian Survey 
High School Student Survey 
Middle School Student Survey 
Parent Telephone Survey 
PROTOCOLS 

District Coordinator Interview 
Campus Administrator Interview 
Counselor Interview 

Teacher Focus Group-Moderator's Guide 
Partner Organization Interview 
Classroom Observation Form 






This survey is secure socket layer (SSL) protected. 
All data are encrypted for transmission. 


GEAR UP - Students Training for Academic Readiness (STAR) 
Teacher, Counselor, and Librarian Survey-2011 


The Texas Center (or Educational Research (TCER) is conducting an evaluation ol the GEAR UP (Gaining Early 
Awareness and Readiness (or Undergraduate Programs) project, also known as STAR (Students Training for 
Academic Readiness) under contract with the Texas Education Agency (TEA). As part o( the evaluation. TCER is 
asking teachers, counselors, and librarians to participate in an on-line survey. The purpose ol this survey is to collect 
information about the experiences of staff working in GEAR UPfSTAR schools. The survey is completely voluntary and 
will take approximately 15 minutes to complete. All information collected through the survey will remain contidential. 
TCER will not share your individual answers with anyone in your school or at TEA. All survey information will be 
reported in aggregate and will not be linked to an individual respondent. If you have any questions about this survey or 
the evaluation, please contact Cathenne Maloney at TCER (512-467-3596 or catherine.maloney@tcer.org). 

By clicking here, then NEXT, you are agreeing to complete this survey. 


O 






GEAR UP - Students Training for Academic Readiness (STAR) 
Teacher, Counselor, and Librarian Survey-2011 


If you require a paper and pencil version ol the survey, please contact Dana Beebe at 800-580-8237. 
Please complete the online survey by April 29. 2011- Thank you tor your participation! 


GENERAL INFORMATION 



School Name 


1 . What grades do you currently work with at this 
school? (Mark all that apply.) 


— a □ □ □ □ 


2. Including this school year, how many years have you been employed in your current position 
(e.g.. as a counselor)? 


3. Including this school year, how many years have you been working in your current position 
at this schooP 


4. What is your gender? 
OMale 
O Female 


5. Which of the following best describes your race or ethnicity? 
O White 

O African American 
O Hispanic'Latino 
O Other 


If other, please specify 


6. What is your highest educational attainment? 
O Bachelor's degree 
O Enrolled in master's coursework 
O Master's degree 
O Enrolled in doctoral coursework 
O Doctorate 
O Other 


If other, please specify 




:i2 















7. Please indicate the extent ot your agreement with each of the following statements. 


Teachers in this school share an understanding about how Advanced 
Placement (AP) strategies may be used to enhance learning. 

Strongly 

Disagree 

o 

Disagree 

o 

Unsure 

o 

Agree 

o 

Strongly 

Agree 

o 

The principal consults with staff betore making decisions that may aftect our 
ability to work in vertical teams. 

0 

o 

o 

0 

o 

In this school, there are clear expectations that all students will be prepared 
for postsecondary educational opportunities. 

o 

o 

o 

o 

o 

1 incorporate Information about college readiness into my content-area 
lessons. 

o 

o 

0 

o 

o 

Teachers in this school are continually learning and seeking new ideas. 

0 

o 

0 

0 

o 

The principal in my school actively encourages teachers to pursue 
professional development geared towards AP strategies ard vertical 
teaming. 

0 

o 

0 

0 

o 

Teachers are not afraid to learn about new educational approaches and use 
them with their class(es). 

o 

o 

o 

o 

o 

1 have received sufficient training to incorporate AP strategies in my classes. 

0 

o 

0 

0 

o 

Parents support our school’s emphasis on college readiness. 

o 

o 

o 

o 

o 

The principal is an elfective leader for vertical teams in this school. 

o 

o 

o 

o 

o 

Overall, considering the uses ot vertical teams in my school today. 1 am 
contident that this use is leading to increased student achievement. 

0 

o 

0 

0 

o 

The pnncipal encourages teachers to be innovative and try new methods. 

o 

o 

o 

o 

o 

GEAR UP goals are clearly communicated to parents and the community. 

o 

o 

o 

o 

o 

The principal is willing to support-through funding or manpower-teachers' 
eftorts at vertical teaming. 

0 

o 

0 

0 

o 

Teachers recerve adequate administrate support to incorporate vertical 
teams. 

0 

o 

o 

0 

o 

Teachers and administrators refy on research-proven teaching and learning 
principles in making decisions about instruction. 

o 

o 

o 

o 

o 

When our school has professional development focused on vertical teams, 
the principal often particpates. 

0 

o 

0 

0 

o 

The surrounding community actively supports our emphasis on college 
readiness. 

o 

o 

o 

o 

o 

Teachers in this school are generally supportive of vertical teaming etforts. 

o 

o 

o 

o 

o 

This school provides a variety of opportunities for parent involvement. 

0 

o 

0 

0 

o 

GEAR UP goals are clearly communicated to staft. 

0 

o 

o 

0 

o 

I am aware of an advisory committee that assists with GEAR UP 
implementation. 

o 

o 

o 

o 

o 

1 have received sufficient training to use student test scores and 
achievement/accountability data in planning individual academic programs. 

0 

o 

0 

0 

o 
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PREPARATION FOR HIGHER EDUCATION 


8. How often do you provide students with counseling or advice about the following: 



Rarely = 1 or 2 limes a YEAR. Sometimes 

= 1 or 2 times a MONTH. Often = 1 or 2 times a WEEK 


Recommended High School Program or 
Distinguished Achievement Program 

Never 

0 

Rarely 

0 

Sometimes 

O 

Often 

0 

Almost Every 
Day 
0 

Post-secondary admissions requirements 

O 

O 

O 

O 

O 

Post-secondary linancial ad. scholarships, or 
college applications 

O 

O 

O 

O 

O 

ACT/SAT preparationtesting 

o 

o 

o 

o 

o 

Career counseling 

o 

o 

o 

o 

o 

Vocational and technical programs 

O 

o 

o 

o 

o 

9. How olten do you provide parents with counseling or advice about the following: 



Rarely = 1 or 2 times a YEAR. Sometimes = 

1 or 2 times a MONTH. Often = 1 or 2 times a WEEK 


Recommended High School Program or 
Distinguished Achievement Program 

Never 

O 

Rarely 

O 

Sometimes 

O 

Often 

O 

Almost Every 
Day 

O 

Post-secondary admissions requirements 

o 

o 

o 

o 

o 

Post-secondary tmancial ad. scholarships, or 
college applications 

o 

O 

O 

O 

O 

ACT/SAT preparationtesting 

0 

0 

o 

o 

0 

Career counseling 

o 

o 

o 

o 

0 

Vocational and technical programs 

o 

o 

o 

o 

o 

















VERTICAL TEAMS 


GEAR UP.STAR supports vertical teams ol middle and high school teachers in the core content areas to develop an 
aligned mkJdle-to-high school curriculum. GEAR UP/STAR also supports vertical teams of counselors. 


1 0. Please respond to each of the following items with respect to vertical teams in your school this year (August 2010- 
July 2011). 


Yes 

No 

1 have attended or wit! attend a vertical teaming training this year. 

0 

O 

My school requires that 1 participate in vertical team training. 

o 

o 

Mv school provides release time or paid time to DarticiDate in vertical team tramina. 

O 

o 

Mv school provides release time or p aid time to participate in vertical team plannina. 

O 

o 

Mv school provides release time or paid time lor team curriculum writina. 

O 

o 


11. How trequently during did your vertical team meet this year? 


O At least once a week 
O At least once a month 
0 1-2 times a semester 
0 1-2 times a year 
O We have never had a meeting. 


12. To what extent have each ol the following issues been a challenge in implementing vertical teams in your school? 

Time.'scheduling constraints 

Large Extent 
0 

Moderate Extent 
0 

Small Extent 
0 

Not at All 
0 

Inadequate leadership or guidance 

o 

o 

o 

o 

Insufficient teacher participation 

O 

O 

O 

O 

Poor communication between teachers 

O 

o 

o 

O 

Teacher turnover 

O 

o 

O 

O 

Vertical teaming is not a priority 

o 

0 

0 

0 


1 3. What needs to be in place in your school to make vertical teaming effective? 


14. Please indicate the position in which you currently work. (Mark only one.) 

Teacher Counselor Librarian 

O O O 


Teachers are routed 
past the next section 
which is questions for 
counselors only. 
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Counselors are 
routed to the next 
section. 


Librarians are routed 
to the end of the 
survey. 





















This Section is for Counselors Only 


1 5. Consider each ol the following counseling tasks. Please rank the level of importance for each. 


Assisting students with grades and achievement issues 

Least 

Important 

O 

o 

Neutral 

O 

o 

Most 

Important 

O 

Providing support for students' career goals 

O 

o 

O 

o 

0 

Helping students plan and prepare for postsecondary education 

O 

o 

O 

0 

0 

Assisting students with matters related to personal growth 

O 

o 

o 

o 

0 

Coordinating GEAR UP activities 

o 

o 

o 

o 

o 

Providing parents with college planning information 

o 

o 

o 

o 

o 

Providing parents with support and services 

o 

o 

o 

o 

o 


16. Consider each of the following counseling tasks. Please indicate the percentage ol your time spent on each of these 
activities at your current school this year. Note. The total of all percentages must sum to 100%. 


Scheduling courses 

Assisting students in course selections 

Counseling for postsecondary admissions 

Testing 

Career counseling 

Counseling related to students' personal issues and concerns 

Other counseling tasks 

Coordinating GEAR UP activities 

Providing parents with college planning information 

Providing parents/families with non-academic support and services 

TOTAL {out of 100) 

Click to continue, then hit NEXT button O 

Counselors are routed to the end of the survey. 
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Questions for Teachers 


17. What is your primary teaching assignment? (Mark only one.) 

O Mathematics 
O Science 

O English language arts/reading 
O Social studies/social science 

O Sell-contained (i.e.. teach multiple subjects to the same group ol students) 
O Other 

II other, please specify: 


1 8. About how olten do you interact with colleagues in each ol the lollowing ways? (Select only one response tor 
each statement.) 

Rarely = a lew times a YEAR. Sometimes = once or twice a MONTH. Otten = one or twice a WEEK 


Almost 

Never Rarely Sometimes Olten Daily 

As a teacher I... O O O O O 

have inlormal discussions with colleagues regarding 
strategies lor vertical teams. 


receive feedback Irom other teachers based on their 
observations ol my teaching. 

O 

o 

0 

0 

o 

provide feedback to other teachers based on my observations 
ol their teaching. 

O 

o 

o 

o 

o 

consult with other teachers about students' academic 
performance. 

o 

o 

o 

0 

o 

work with a subject-area peer(s) on my campus to develop a 
lesson plan or class activity. 

o 

o 

0 

0 

0 

work with a subject-area peer(s) Irom a leeder pattern 
campus to develop a lesson plan or class activity. 

o 

o 

o 

o 

o 

work with a colleague(s) in a dillerent subject area to develop 
a lesson plan or class activity. 

o 

o 

o 

o 

o 

act as a vertical team coach or mentor to other teachers or 
stall at my school. (May include teaching in-service workshop 
in your school.) 

o 

o 

0 

0 

0 

receive vertical team coaching or mentoring Irom an external 
(non-school) source such as a professional curriculum 
developer, or university faculty fellow. 

o 

o 

0 

0 

0 


: 














ADVANCED PLACEMENT 


19. 1 have attended an AP summer institute offered by the College Board. 

Yes 

O 

No 

O 

20. 1 am teaching one or more AP courses this school year. 

O 

o 


Respondents who answered "yes" are routed to the next set of questions. 
Respondents who answered "no" are routed to the University Faculty Fellows Section. 

21. Including the current school year, how many years have you been teaching AP or pre-AP courses? 


Yes No 

22. Are your AP students required to take the AP exam? O O 

23. Describe one instructional strategy learned in AP training that you have used successtully in your classroom(s). 


24. What changes would make the AP program at your school more elfective? 


I UNIVERSITY FACULTY FELLOWS 



25. Did you attend a university Faculty Fellows orientation meeting? 

Yes 

O 

No 

O 

26. Have you been assigned a university faculty member through the Faculty Fellows program at 

O 

O 


Texas ASM Unrversity-Kmgsville or Texas ASM Corpus Christi University? 

Respondents who answered "yes" are routed to the next set of questions. 
Respondents who answered "no" are routed to the end of the survey. 

27. How trequently do you communicate with your university Faculty Fellow? 

O At least once a week 
O At least once a month 
0 1-2 times a semester 
O Other 

If other, please specify: 
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28. How uselul were any lectures, presentations, or demonstrations given by a university Faculty Fellow in your class? 
O Very uselul 

O Somewhat uselul 
O Not very uselul 

O My Faculty Fellow did not give a lecture/presentation/demonslration 

29. What were the most uselul or effective activities involving your university Faculty Fellow mentor? 


30. How could the university Faculty Fellows program be improved? 


To complete the survey, please hit the submit button. 
Thank you for your participation! 

aiTCER 


P.O. Box 679002. Austin. TX 78767-9002 
vnvw.tcer.org 
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Students Training for Academic Readiness (STAR) 
High School Student Survey-Spring 2011 



• Use a No. 2 pencil only. * Make solid marks tha« fill the response 

• Oo not use Ink, ball point, or fell tip pens, completely. 



• Erase cleanly any marks you wish to cltanpe. 

• Make no stray marks on this form. 

INC ORRECT: 


Please answer each ol the following questions about the GEAR UP program at your school. 
Your individual responses are confidential. You will nol be identified by name in any reports. 

Thank you for completing this survey. 


General Information 


First Name 


mr 

MINI 

Last Name 


I” 

MINI 

School Name 


ii i ::::::::::: 

:::::::: mm 


Student ID 











0O0O00000 
2} *2} CD *2} *2 *2 *2} *2} 

GDCDC0CDCE)(3)(2J(2) 

©O00O000 
<D <2) CD ® <2! <2! 

CD CD CD (2) (2s <2) <2s (25 


ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 


P~ 

T 1- 

Ti7 

±L 

— 

2T 

— 


TT 

T— 




ry - 



0 9 O 10 Oil O 12 



O Male O Female 


O Less than 30 minutes 
O 30 to 60 minutes 
O 1 to 2 hours 
O More than 2 hours 
O My teacher does not assign homework. 



O HrspanioLatino 

(including Mexican American) 
O Alrican American 
O White 

O Other (describe) 


OOOOOOOO 


[SERIAL] 




r 

55 

55" 

5rr 

3f 


f - 

TT 

TT 

fTT 

TT 

~ 

TiT 




School and Extra-Curricular Activities 


— 




~ 


— 


~ 


et 



f. Class field trip to learn more about a subject discussed in class 

o 

o 

o 

o 

o 

>s 

i7 

g. Attending a family activity at school with a parent or guardian 
(including events with FACE) 

o 

o 

o 

o 

o 

i5 

h. Attending a presentation by a business person or a Junior 
Achievement activity 

o 

o 

o 

o 

© 

A3 

i. University professor visits to your class 

J. Used the Go Center for college or career information 

o 

o 

o 

o 

o 

o 

o 

o 

o 


BJ 


tl-' 




37 









luloring to r an academic subject 

Mentoring by an adult who is not your parent, guardian, or a 

teacher 

Counsel ing about y our grades 


Every 

Never Rarely Sometimes Olten Day 

O O O O O 


O 




pout your gtc 
study skills 


O 


O 


o 


Worksh op on study : 

Workshop to learn about the ACT. SAT. or other college 
entrance exam 


O 




O 


o_ 

O 

o 


o 


o 


o 



a. Visited a college campus with your school 

b. Attended a college or career lair at your school 

c. Attended a college planning workshop at your school (learning about college entrance exams and 
entrance requirements) 

d. Received assistance at school completing college, financial aid. and scholarship applications 

e. Taken a career inventory/test about career in terests at your school 
I. Learned abo ut careers a t your school and'or career requirements 

employers 


O 

O 

O 


Vis, 


PSIISM 


h. Interned or shadowed someone at a job 

i. Had a school administrator or teacher visit your home 


O 

***** 

o 

o 

Q 

O 

o 


Familiarity with Colleges and Universities 


ate how (amiliar you are with each type 


ol college and university. 


No 

: amil 


OOI 


Fa 


ewnat 

Tiliar 


Very 

Familiar 


a. Community or junior colleges (two-y ear programs) 

b. Four-year colleges and universities 

c. Vocational or technical schools 



choose T. It an item is VERY important, then choose ”5". 


colleges and 
ALL important, then 

Not At All 
Important 

1 2 3 


a. Visited a college or university 

b. Oiscussed college opportunities with a school counselor 

c. Discussed college opportunities with your teacher 

d. Discussed college opportunities with your parent(s) or guardlan(s) 

e. Discussed college opportunities with a brother or sister 


© © © 


© © © 


© © © 


© © © 


Discussed college opportunities with another family member 


© © 


© 


g. Looked at a guide to colleges and universities (e.g.. Barron' sf 

h. Commercials or advertisements (TV. online) - 

i. Other (dr 


© © 


© 


© © 


© 


beK 


© © 


© 


© © 


© 


A 

© 

© 

© 

© 

© 

© 

© 

© 

ffi 


Very 
Important 
5 

© 


© 

© 


© 

© 


© 

© 


©_ 

© 
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Q A 'GEAR U P/STAR repres entative 

Q Myparjn l(s) or guardian 

O My schoo l counselor 

O Myleache r(s) 

Q Other (ple ase explain): 


Q My pnncipal/assislant pr incipal 
O My brother or sister 


O Another family member (e. g.. an aunt, uncle , cousin, or grandparent) 
O No one has spoken to me about college entr ance requirements 



Q A GEA R UP’STAR repres entative 

Q Mypare nt(s) or guardian 

O My sch ool counselor 

Q My leacher(s) 


O Oth er (please explain): 


O My principal'assistant pri ncipal 
O My brother or sister 
O Another tamity member (e. g. 


O No one has spcken to me al 


LJOU 


i aunt, uncle, c ousin, or grandparent) 
linancial aid opportunities 



a. A four-year college or univeisit y 

b. A community or juni or college (two-year program) 

c. A vocational or technical school 


Definitely Probably 
O O 


O 


O 


O 

O 


Not 

Sure 

O 

o 

6 


Probably 

Not 


Detinitely 

Not 


O 


O 


O 


College Planning 



Have 

Taken 


a. PSAT 

b. PLAN 
c SAT 


Ran to 
Take 


O 


O 


O 


Will Not 
Take 


Unsur« 


O 


O 


O 


O 


O 


O 


dTACT 


fHE/T 


Have 

Taken 

_ O _ 
O 


Plan to 
Take 


O 


Will Not 
Take 

O 


Unsure 


O Disti nguished Achievement Program 
O Recommended High School Program 
O Minimum Graduation Plan 


O Unsure 


O Other (describe): 


Post High School Plans 


Less than high school 
High school 


not an assccate s 


High school plus vocational school 

Associate's degree (two-year community college) 

Some college but less than a four-year deg 

Bachelor* s degree (four-year college or university degree) 

Graduate or professional degree {master’s. Ph.D.. law degree. M.D., e^r 
Don't know 


tte 9 rtH) > 
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•THIS SECTION FOR SENIORS ONLY 
College Applications 


r— i 


[— l 


rn 


— 


rn 


— 


nn 


— 


— 


m 


irn 


— 


O I want to go into Ihe military 


rn 


— 


IT 


r~ i 


— 


[— l 


— 


— 


77 




each item.) 


a. A lou r-year ^ollege or university 

b. A commi 

c. A vocatic 


type ot post- secondary program^ 


Will Not Plan to Have Applied (sent 
Apply Apply application materials) 


■ 


Have Been 
Accepted 


b. A com munity or )umor college (two-year prog ram) 
ional or technical school 


O 


O 


O 


O 


O 


O 


O 



C Nothing is Ifcely to prevent me from attendi ng a college or university 
O It costs too much'can't altord it 


need\vant to work 

am not interested n coleg e 


3 Other (pi 




O I have responsibilities to~lamily 


O College is too lar Irom home 
Q My grades are not good enou gh 


Q I have a usability 

Q I want to get marned 


Thank you for taking the survey. 


®Te*as Center lor Educational Research, P.O. Ba< 679002, 
Austin. TX 78767-9002. www.tcer.org 
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Students Training for Academic Readiness (STAR) 

Middle School Student Survey-Spring 2011 

• Erase cleanly any marks you wish to change. 

• Make no stray marks on (Ns form. 

INCORRECT: 


Please answer each of the following questions about the GEAR UP program at your school. 
Your individual responses are confidential. You will not bo idontifiod by name in any reports. 

Thank you for completing this survey. 


General Information 


First Name 

Student ID 





























Last Name 

3D O *3P O r£i ® ® 
0OO000000 
03303030*2 
GO8000000 
•33 3 © *33 O *2* 3 3 *2* 
33333300 3 
3D3330000 O 
3*3 000000 O 
® ® 0 ® ® 0 0 0 O 
®®®0® 000 3 

m i 


























School Name 


1 











T 
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Use a No. 2 pencil only. 

Do not use Ink, ball point, or fell tip pens 


MARKING INSTRUCTIONS 

• Make solid marks (hat fill the reapona 
completely. 




CORRECT: 


O Yes O No 



0 6 0 7 0 8 



O Male O Female 



O Base Math 
O Algebra 1 
O Algebra 2 
O Geometry 

O Other math course (please list): 


4. Which ot the following best describes you? 
{Mark only one.) 

O HispanicLatino 

(including Me>ican American) 

O Alrican American 
O White 
O Other (describe) 


O Gilted and Talented program 
O Career and Technology courses 
O Special education 
O Pre-AP or AP courses (please list): 



O Less than 30 minutes 
O 30 to 60 minutes 
O 1 to 2 hours 
O More than 2 hours 
O My teacher does not assign homework. 
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ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 


m 

M 
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m 
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ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 


ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 

ED 
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ED 

ED 

ED 

ED 

ED 

CD 

CD 




School and Extra-Curricular Activities 


— 

— 


— 


1 7. Please mart how often you have participated in 


— 


— 


m 


— 


m a. 


— 


— 


rn 


— 


— 




— 


— 


— 





Rarely 
(1 or 2 
times a 
Never YEAR) 


Sometimes 
(1 or 2 
times a 
MONTH) 


Often 

(1 or 2 Almost 
times a Every 
WEEK) Day 


Tutoring for an academic subject (e.g.. math, science. English' 
language a ds, social studies) 

b. Mentoring by an adult who is not your parent, guardian, or a teacher 

c. Counseling abo ut your gra des 

d. Wor kshop on study skil ls 

e. 


O 


O 


O 




O 


O 


O 


O 




O 


t. 


h. 


Workshop to learn about the ACT. SAT. or other college entrance exam O O O 

Class field trip to a museum, park, or other site to learn more about a 

subject discussed in class O O O 

Attending a family activity at school with a parent or guardian (including 

events with Fathers Active in Communities and Education [FACE]) O O O 


Attending a presentation by a business person or a Junior Achievement 
a ctivity 


i. U niversity prolessor visits to your class 

j. Used the Go Center for college or career information 


kj 




Q 


O 


O 


O 






Q 


q 

Q 

q 

Q 

o 

o 

q 

o 

q 

o 





Yes 

No 

j: 

a. Visited a college campus with your school 

o 

c 


b. Attended a college or career fair at your school 

o 

o 

3u 

c. Attended a college planning workshop at your school (learning about college entrance exams ana 
entrance requirements) 

o 

o 


d. Received assistance at school completing college, financial aid. and scholarship applications 

o 

o 


e.T aken a career inventory'test about career interests at you school 

o 

o 


1. Learned about careers at your school i available careers, applying for careers, creating resumes, 
educational and training requirements for specific careers) 

Q 

o 

I'-t 

g. Visited local employers 

o 

q 


h. Interned or shadowed someone at a job 

i. Had a school administrator or teacher visit your home 

c 

o 


-MS 



Familiarity with Colleges and Universities 


Please indicate how familiar; 
each Item.) 


□ 

□ 

ED 

□ 


Not 

Familli 


Somewhat 

Familiar 


Very 

Familiar 


a Community or junior colleges (two-year programs) 

b. Four-yeaTcolleges and unive rsities 

c. Vocational or technical schools 


O 


"o' 

~cT 


o 

"cT 



a. Visited a college or uni versity 


b. Discussed college opp ortunities with a school counselor 
cTDiscussed college opportunities w ith your teacher 


0. Discussed college opp ortunities with your parent(s) or guaidian(s) 

eTDiscussed college o pportunities with a brother or sister 

1. Discussed college opportunities with another lamily member (e g.. an aunt, uncle, 

o r cousin) 

g. Looked at a guide t o colleges and universities (e.g , Barron's ) 

h. Commercials or ad vertisements (TV. online) 

L Other (describe): 


Not At All 



Very 

Hi 

Important 


ImporlanI pH 

1 

2 

3 

4 

5 

mm 

o _ 

< 2 1 

© 

© 

© 

Mum 

cd 

© 

© 

© 

© 

d 

tD 
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© 

© 

iTi 

© 

iTi 

d 
1 | 

•x> 

CD 

© 

© 

© 

© 

© 

. 1 1 

. d 






d 

CD 

m 

3 

3 
f n 

© 

/Tl 

© 

(T\ 

d 
( 1 

w 

<D 

© 

© 

© 

© 

. 1 1 

d 

CD 

© 

© 

© 

© 

dl 


O A GEAR UPi STAR representative 


My paie nt(s) or guardian 
o My scho ol counselor 

o My teach er(s) 

o Other (please explain): 


C My prindpa lassistant principal 
C My brother or sister 


O 


No one has spoken to me a bout college entrance requirements 


O Another lamily member 





o A GEAR UP/STAR representative 
O My parent(s) or guanSan 

O My school coun selor 

O My teacher(s) 

o Other (please explain): 


My principal'assistant principal 


* My brother or sister 


13. 


you could 
? (Mark 



Definitely Probably 


1 = 

d 

d 

d 

d 

d 

d 

d 

d 

d 




— 


~ Another lamily member (e. g.. an aunt, uncle, cousin, or grandparent) 
C No one has spoken to me about finan cial aid opportunities 


r~ 

TT 


Probably Definitely 
Not Sure Not Not 


a. 

A four-year college or university 

O 

O 

o 

o 

Q 

67 

c. 

A community or junior college (two-year program) 
A vocational or technical school 

O 

O 

o 

O 

o 

o 

o 

o 

Q 

O 
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Post High School Plans 


— 

— 


— 


— 


r— l 


— 


— 




— 




— 








— 


_ 


— 


— 


— 


~ 



plan lo earn? ( Mark only one.) 


Less than h igh school 


O high school 

O High school plus vocational school 

Q Some colle ge but less than a lour-year degree (not an associate's degree) 
A ssociate's degree (two-year c ommunity college) 

O B achelor's degree (tour-year college or unive rsity degree) 

O Graduate or pro fessional degree (master 1 s. Ph.D.. law degree. M.D_etc.) 
Q Don't know 


Thank you for taking the survey. 


©Texas Center lor Educational Research. P.O. Box 679002. Austin, TX 70767-9002. wvrvr.tcer.org 
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Students Training tor Academic Readiness (GEAR UP/STAR) 
Parent Telephone Survey - Spring 2011 


Introduction 

Hello! My name is (interviewer’s name). I am calling on behalf of the Texas Center for Educational 
Research. 

We arc conducting a survey with parents of students who arc attending [school name) to obtain parents’ 
experiences with the school and with activities to help students get ready for college. 

May I speak with the parent or guardian of (child’s name] or the adult in your household who is most 
involved in decisions about the education of this child? 

We would like to talk w ith you about (child's namc)'s and your experiences at school. 

Your name has been randomly selected to participate in this survey. All answers will be kept completely 
confidential. Your participation is voluntary, and if there is a question you don’t wish to answer, please let 
us know and we w ill go on to the next question. 


Arc you at least 18 years old? (If "no”, end survey./ 

{Please note Render of respondent: Female. Male. \ 

Parent Involvcmcnt/Familiarity with School 

I. How many times have you visited (child's name] school in the past year? {Record number of times./ 


2. Which of the following school activities have you participated in over the course of the past school 
year*? 




Volunteer activities for your child’s school 


r conferences 


Observed* visited your child's classroom 


Talked with a teacher or administrator about vour child's education 


Received college planning information or other counseling services 
from the school counselor 


Received a home visit from a teacher, counselor, or administrator at 
your child's school 
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3. Which of the following college and career awareness activities have you participated in at your 
child's school over the course of the past school year? 


1 Activity 

Yes 

No 


1 

2 

h. Attended a college or career fair at your child's school 

1 

2 

c. Attended a workshop on preparing for college (learning about 
applications, financial aid. entrance exams) 

1 

2 

d. Received assistance in completing financial aid. scholarships, and 
college applications 

1 

2 

e. Attended a workshop on careers with your child (available careers, 
applying for careers, creating resumes, educational and training 
requirements for specific careers) 

1 

2 

f. Attend a FACE activity with your child 

1 

2 

g. Other 

1 

2 

If yes (Other), please specify: 


4. How familiar arc you with the GEAR UP/STAR Program at (child's name) school? 

1. Very familiar 

2. Somewhat familiar 

3. Not very familiar 

4. Not familiar at all 

Involvement in Child's Schooling 

5. Over the past school year, how often did you do each of the following activities? 


Activity 

Never 

Several 
Times a 
Month 

Several 
Times a 
Week 

Eveiy 

Day 

a. Assist with or monitor your child's homework 
at home 

i 

2 

3 

4 

b. Tutor your child at home using materials and 
instructions provided by the teacher 

i 

2 

3 

4 

c. Read with your child at home 

i 

2 

3 

4 

d. Discuss school with your child 

i 

2 

3 

4 

c. Talk to other parents about your child's 
school 

i 

2 

3 

4 


Educational Kxpectations/Aspirations 

6. Has (child's name) expressed an interest in going to college? 

1. Yes 

2. No 

3. Don't know 
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7. What is the highest level of education that you think (child's name) will achieve? 

1. Less than high school 

2. High school 

3. Some college but less than a four-year degree 

4. 4-year degree or higher 

5. Don't know 

X. How often do you do each of the following with (child's name)? 


Activity 

Never 


Sometimes 

■mm , 

a. 1 alk about attending college 

1 

7 

3 

4 

b. Help select classes that support (CHILD’S) 
college plans 

1 

2 

3 

4 

c. Talk about taking one or more of the college 
entrance exams (SAT, ACT. PS AT. PLAN) 

1 

2 

3 

4 

d. Talk about financial aid opportunities. 

scholarships, and other resources that might 
provide the money to attend a college 

1 

2 

3 

4 


9. If in the future (child's name) were not to be able to continue his'hcr education after high school for 
some reason or other, what would be the most likely or most important obstacle? 

1 . It costs too much/can't afford it 

2. Hc« she needs,* wants to work 

3. His/her grades are not good enough 

4. Hc'she is not interested in college 

5. Hc’she has a disability (physical, learning, emotional) 

6. Hc'she wants to go into the military 

7. Hc'she wants to get married 

X. Hc’she has responsibilities to parents, brothers and sisters 

9. Hc'she has children 

10. Other/don't know 

1 1. Child not likely to have an obstacle preventing him/her from continuing beyond high school 

10. In the past year, has any one from (child's name] school or the CiLAR UP program ever spoken with 
you about... 



Yes 

No 

Don't 

Know 

a. College entrance requirements. 

1 

7 

3 

b. The availability of financial aid tor college. 

1 

2 

3 

c. The courses your child should take to prepare tor college. 

1 

7 

3 
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Financial Resources for Post-secondary Education 


1 1 . Do you think that [child’s name) could afford to attend a public 4-year college using financial aid. 
scholarships, and your family's resources? 

1. Definitely 

2. Probably 

3. Not sure 

4. Probably not 

5. Definitely not 

12. Do you think that [child’s name) could afford to attend a public community college (two-year) using 
financial aid. scholarships, and your family's resources? 

1. Definitely 

2. Probably 

3. Not sure 

4. Probably not 

5. Definitely not 

I If child is in high school (i.e,, grades 9, JO, 1 L or 12), go to question M.j 
/If child is not in high school, skip to question 18 , / 

Parents of High School Students 

13. Have you received any information from [child's name) school about the graduation plan called the 
Recommended High School Program in Texas? 

1. Yes 

2. No 

3. Don’t know; re fused 

14. Do you know which of the following graduation plans [child's name] is enrolled in? Is it 

1 . The Minimum Graduation Program? 

2. The Recommended High School Program? 

3. The Distinguished Achievement Program? 

4. Don’t know 

15. How familiar arc you with the FAFSA (Free Application for Federal Student Aid) form that a high 
school student must complete to qualify for federal financial aid for college? 

1. Very familiar 

2. Somewhat familiar 

3. Not very’ familiar 

4. Not familiar at all 

16. Do you know if [child's name] has completed the FAFSA form and is eligible for federal financial aid 
for college? 

1 . Yes. my child has completed the FAFSA form 

2. No. my child has not completed the FAFSA from 
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17. Have you begun saving for (child's name) education after high school? 

1. Yes 

2. No 

3. Don't know; re fused 

PtTsonal/lteniographic Information 

IS. Which of the following languages are primarily spoken in your home? 

1. English 

2. Spanish 

3. Vietnamese 

4. Japanese 

5. Chinese 

6. Other / Record the lan^ua^e.l 

19. Which best describes your household? 

1 . Two parents or guardians 

2. Single parent or guardian 

3. Other | specify! 

20. How many years have you lived at your current address? ( Record the number of years. ] 

2 1 . How do you think of yourself? 

1. Black. non-Hispanic 

2. Asian'Asian-American 

3. Latino' Hispanic 

4. White, non- Hispanic 

5. Native American' American Indian 

6. Other 

7. Refused' don't know 

22. How many years of formal schooling have you completed? (Formal schooling includes elementary 
and secondary education. Record the number of years. \ 

23. Have you attended college? 

1. Yes 

2. No 

3. Refused/don't know 

24. If yes, how many years of college have you completed? (College includes postsccondary education. 
Record the number of years.] 

25. What is your current yearly household income? 

1 . Less than $ 1 5 .000 /y car 

2. S 1 5.000-24.999 'year 

3. S25.000-34.999.year 

4. $35.0000-49,999/ycar 

5. $50,000-74, 999/year 

6. More than $75,000/ycar 

7. Refused/don't know 
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Students Training tor Academic Readiness (STAR) 
District GEAR UP/STAR Coordinator Interview Spring 2011 


Administrator Name: District: 

Date: Interviewer: 

New Administrator (to this district) 2010-11: Yes No 

1. Role in GEAR UP/STAR 

a) Overall, how would you say implementation of GEAR UP/STAR has gone this year? ( Deliberately broad 
I o allow lor a wide range of responses.) 

b) Describe your role in implementing the GEAR UP/STAR grant this year. 

c) Does this differ from your role in previous years? Please explain. 

d) What, if any. challenges have you experienced in fulfilling this role? ( Probe lor issues related to time, 
conflicting priorities, lack ol clearly defined project responsibilities.) 

e) Describe the role of campus counselors in implementing the project. 

f) Describe the role of campus teachers in implementing the project. 

g) Describe your relationship with principals on GEAR UP/STAR campuses. 

2. Fifth Year Implementation of GEAR UP/STAR Activities 

What are the key components of your district's plan for implementing GEAR UP/STAR? ( Probe which 

individuals are responsible for implementing components.) 

a) Does your district emphasize certain program components more than others? ( Program components 
include ( 1 ) raising academic standards and improving instruction. ( 2 ) engaging teachers through 
professional development and students through targeted services. (3) increasing student and parent 
access to postsecondary planning information, and (4) building parent and community support .) 

If yes. please explain the reasons behind this emphasis. 

b) Please describe the GEAR UP/STAR activities that have been implemented in your district during the 
2010-11 school year. ( Probe for information about participants.) 

c) How do these activities differ from those offered in previous years to support students' college 
readiness? 

d) Please describe how your district allocates STAR funding between the middle school and the high 
school. Have allocation patterns changed across implementation years? 

3. Vertical Teams 

a) Which faculty and staff comprise your vertical teams under the GEAR UP/STAR project? 

b) What goals or expectations do you have for vertical teaming in your school district? ( Probe how often 
vertical teams are expected to meet.) 
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c) Wha!. if anything, has limited the implementation of vertical teams this year? ( Probe lor issues related to 
lack ol common planning periods, lack ol coordination between high school and middle school, and stall 
resistance .) 

4. Successes and Challenges of Fifth Year GEAR UP/STAR Implementation 

Please think about the successes and challenges you encountered in implementing the GEAR UP/STAR 

project this school year. 

a) What were the primary successes your district experienced in implementing GEAR UP/STAR during this 
school year? 

b) What were the primary barriers or challenges to implementing GEAR UP/STAR this school year? 

c) How did your district resolve or overcome these challenges? 

5. Communication of GEAR UP/STAR Activities to Staff, Students, Parents, and Community 

Members 

a) How have GEAR UP/STAR activities been communicated? ( Probe lor communication with teachers , 
students, parents, and community members .) 

b) What measures have been taken to encourage participation in GEAR UP/STAR activities? ( Probe lor 
measures addressing with teachers, students, parents, and community members.) 

6. Role of GEAR UP/STAR Partner Organizations 

a) Please describe how GEAR UP/STAR partner organizations have participated in the implementation of 
GEAR UP/STAR activities during the 2010-11 school year. 

b) Which partner organizations played the greatest role in implementing GEAR UP/STAR activities? 

c) Overall, are you satisfied with the participation of partner organizations? 

d) How could the participation of GEAR UP/STAR partner organizations be improved? 

7. Continuation of GEAR UP/STAR in the 2011-12 School Year 

a) What specific activities are you planning for next year's implementation of GEAR UP/STAR? Do these 
activities differ from those of the 2010-11 school year? 

8. STAR Sustainability 

a) Please describe any plans your district may have for sustaining STAR after grant funds expire in 2012. 
[Probe lor challenges and supports to sustainability, differences in the types ol services offered, other.) 

9. Other 

a) Is there anything that I have not asked that you think is important to understanding GEAR UP/STAR 
implementation on your campus this year? 
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Students Training tor Academic Readiness (STAR) 
Campus Administrator Interview Spring 2011 


Administrator Name: Campus/District: 

Date: Interviewer: 

Years as an administrator Years as an administrator on this campus 

1. Role in GEAR UP/STAR 

a) Overall, how would you say GEAR UP/STAR has gone this year? (Deliberately broad to allow lor a 
wide range ol responses .) 

b) Describe your role in implementing the GEAR UP/STAR grant this year. 

c) Does this differ from your role in previous years? Please explain. 

d) What, if any. challenges have you experienced in fulfilling this role? ( Probe for issues related to time, 
conflicting priorities, lack of clearly defined project responsibilities.) 

2. Fifth Year Implementation of GEAR UP/STAR Activities 

a) What are the key components of your campus’s plan for implementing GEAR UP/STAR? ( Probe for 
individuals who are responsible for implementing components.) 

b) Does your district emphasize certain program components more than others? ( Program components 
include ( 1 ) raising academic standards and improving instruction. ( 2 ) engaging teachers through 
professional development and students through targeted sen/ices. (3) increasing student and parent 
access to postsecondary planning information, and (4) building parent and community support.) 

If yes. please explain the reasons behind this emphasis. 

c) Please describe the GEAR UP/STAR activities that have been implemented on your campus during 
the 2010*1 1 school year. (Probe lor participants.) 

d) Do these activities differ from those offered in previous years to support students' college readiness? 
If so. how? 

e) Describe the STAR teacher professional development activities offered this school year. (Probe for 
information about vertical team training, faculty fellows mentoring.) 

f) Have you observed any changes in instruction or classroom practice that is a result of STAR 
professional development? 

If yes. please describe these changes. 

g) Please describe how your district allocates STAR funding between the middle school and the high 
school. Have allocation patterns changed across implementation years? 
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h) MIDDLE SCHOOL ONLY: Has STAR implementation changed since the initial student cohort 
(seventh graders in 2006-07} is now in high school? {Probe for changes in the types of sen/ices 
offered, levels of implementation, numbers of students served, other.) 

It yes. please describe why changes may have occurred. {Probe for changes in funding, 
administrative support, etc.) 

3. Successes and Challenges of Fifth Year GEAR UP/STAR Implementation 

Please think about the successes and challenges you encountered in implementing the GEAR 

UP/STAR project this school year. 

a) What wore the primary successes your campus experienced in implementing GEAR UP/STAR 
during this school year? 

b) What were the primary barriers or challenges to implementing GEAR UP/STAR this school year? 

c) How did your campus resolve or overcome these challenges? 

4. Communication of GEAR UP/STAR Activities to Staff, Students, Parents, and 

Community Members 

a) How have GEAR UP/STAR activities been communicated this school year? ( Probe for 
communication to teachers, students, parents and community members.) 

b) What measures have been taken to encourage participation in GEAR UP/STAR activities? ( Probe 
for measures related to teachers, students, parents and community members.) 

5. Role of GEAR UP/STAR Partner Organizations 

a) Please describe how GEAR UP/STAR partner organizations have participated in the implementation 
of GEAR UP/STAR activities during the 2010-11 school year. 

b) Which partner organizations played the greatest role in implementing GEAR UP/STAR activities? 

c) Overall, are you satisfied with the participation of partner organizations? 

d) How could the participation of GEAR UP/STAR partner organizations be improved? 

6. Continuation of GEAR UP/STAR in the 2011-12 School Year 

a) What specific activities are you planning for next year's implementation of GEAR UP/STAR? 

b) Do these activities differ from those of the 2010-1 1 school year? If so. how? 

7. STAR Sustainability 

a) Please describe any plans your district may have for sustaining STAR after grant funds expire in 
201 2. {Probe for challenges and supports to sustainability, differences in the types of services 
offered, other.) 

8. Other 

a) Is there anything that I have not asked that you think is important to understanding GEAR UP/STAR 
implementation on your campus this year? 
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Students Training tor Academic Readiness (STAR) 
Counselor Interview Spring 2011 


Counselor NameTitle: Campus/District: 

Date: Interviewer: 

Years as a counselor Years as counselor at this school 

1 Role in Implementing GEAR UP/STAR 

a) Overall, how would you say implementation of GEAR UP/STAR has gone this year? ( Deliberately 
broad to allow for a wide range of responses.) 

b) Please describe your role in implementing GEAR/UP STAR during this school year. ( Probe for activities 
addressing college awareness, college readiness, and college planning.) 

c) Does this differ from your role in previous years? Please explain. 

d) What, if any. challenges have you experienced in fulfilling this role? ( Probe for issues related to time, 
conflicting priorities, lack of clearly defined project responsibilities.) 

2. Filth Year Implementation ot GEAR UP/STAR Activities 

a) What are the key components of your campus's plan for implementing GEAR UP/STAR? ( Probe for 
information on components related to academic support, informational resources, parent activities, and 
community support, and the individuals involved in implementing components.) 

b) Please describe the GEAR UP, 'STAR activities that have been implemented on your campus during the 
2010-11 school year. ( Probe for information on activities related to academic support, informational 
resources, parent activities, and community support, and the activity participants.) 

c) How do these activities differ from those offered in previous years to support students' college 
readiness? 

d) Have you observed any effects of STAR activities? ( Probe for changes in parent, student, and/or 
teacher behavior.) 

3. Successes and Challenges ot Filth Year GEAR UP/STAR Implementation 

Please think about the successes and challenges you encountered in implementing the GEAR UP/STAR 

project this school year. 

a) What were the primary successes your campus experienced in implementing GEAR UP/STAR during 
this school year? 

b) What were the primary barriers or challenges to implementing GEAR UP/STAR this school year? 

c) How did your campus resolve or overcome these challenges? 

d) What resources or assistance are still needed to improve STAR implementation? 
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4. Vertical Team Training for Counselors 

a) Please describe professional development activities that you have received this school year. (Probe for 
trainings related to vertical teams.) 

b) What effect has training had on counseling services in this school or district? 

5. Parental Involvement 

a) Were there any counseling services or activities that you offered to parents? 

b) If yes. how did you encourage parents to participate? 

c) How would you describe the level of parent participation? 

6. Role of GEAR UP/STAR Partner Organizations 

a) Please describe how GEAR UP/STAR partner organizations have participated in the implementation of 
GEAR UP/STAR activities during the 2010-11 school year. 

b) Which partner organizations played the greatest role in implementing GEAR UP/STAR activities? 

c) Overall, are you satisfied with the participation of partner organizations? 

d) How could the participation of GEAR UP/STAR partner organizations bo improved? 

7. Continuation of GEAR UP/STAR in the 2011-12 School Year 

a) What specific activities are you planning for next year's implementation of GEAR UP/STAR? Do these 
activities differ from those of the 2010-11 school year? 

8. Other 

a) Is there anything that I have not asked that you think is important to understanding GEAR UP/STAR 
implementation on your campus this year? 
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Students Training tor Academic Readiness (STAR) 
Teacher Focus Group - Moderator's Guide 
Spring 2011 


Participants: Campus: 

District: 

Date: 

Moderator: 

Moderator Introduction 

[Distribute Index cards to participants. Ask participants to write their name, teaching assignment. Collect cards 
at the end as a record ot teacher participation.] 

Purpose of Teacher Focus Group: 

Your school has received funding under the federal Gaining Early Awareness and Readiness for 
Undergraduate Programs (GEAR UP) to support the Students Training for Academic Readiness Program 
(STAR). The Texas Education Agency has contracted with the Texas Center for Educational Research 
conduct a research study of the STAR program. This focus group is part of that research. 

Here are some Ground Rules: 

1. Recording the session — responses confidential: individuals not identified 

2. One person speak at a time 

3. Speak loudly enough to bo picked up on tape 

4. All views are important — need open, candid responses 

5. Everyone participates 

6. We need to stay on schedule (40-45 minutes). I may interrupt you to get back on task 

Participant Introductions 

[Begin taping. Give the name ot the school. Ask participants to give their names and teaching assignments, 
grades taught, and number of years teaching] 

1. Teachers’ Role in GEAR UP/STAR Implementation 

a) Overall, how would you say GEAR UP 'STAR has gone this year? ( Deliberately broad to allow tor a wide 
range ot responses.) 

b) Describe teachers' role in implementing GEAR UP/STAR this school year. ( Probe tor college awareness, 
college readiness, and college planning activities alter initial response.) 

c) Did this differ from teachers' role in previous years? Please explain. 

d) What, if any, challenges did teachers' experience in fulfilling this role? ( Probe tor issues related to time, 
conflicting priorities, lack ot clearly defined project responsibilities, time.) 

e) From where or whom do you receive support and assistance with GEAR UP implementation? 


2. Vertical Teaming 

a) Please describe how verticals teams are implemented on this campus. ( Probe tor membership ot teams, 
differences among subject areas, and the goals ot vertical teams.) 

b) Are there any district or campus expectations about teachers' participation in vertical teams? 
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c) What, if anything, has limited the implementation of vertical teams this year? ( Probe for issues related to 
lack of common planning periods, lack ot coordination between high school and middle school, and stall 
resistance) 

d) Have you noticed any effects from the vertical teaming implementation? 

3. Professional Development for Vertical Teaming 

a) Describe the professional development provided this school year to support vertical teaming. ( Probe who 
participated in vertical reams.) 

b) What aspects of this training were most useful to you? And least useful? 

c) Are there any district or campus expectations with respect to teachers' participation in vertical team 
training? 

d) Were there any efforts to align the curriculum on your campus that included collaboration with university 
faculty fellows and/or university personnel? If so. please describe. 

e) Have you attended any other training or professional development other than vertical teaming and AP 
strategies? ( Continue with: Were they helpful? Effective? Arc you implementing these strategies ?) 

4. Faculty Fellows Mentoring Program 

a) Did you participate in the Faculty Fellows Program this year? 

b) If yes. please describe the kinds of activities that are offered through the program. 

c) Were these activities helpful? Why or why not? 

5. Informational Resources 

a) What informational resources are available to you to share with students to assist them with college 
preparation and planning? {Probe tor the most and least useful resources.) 

b) Have you used these resources with students? If yes. explain how. 

6. Parent Support 

a) Please describe any activities offered by your school this year that are designed to increase parent 
involvement in students' education. 

b) Have you participated in these activities? 

c) Have you observed any effects of these activities? If yes. please explain/describe. ( Probe for the level of 
parental involvement and participation, and elfects. such as student achievement.) 

7. Other 

a) Is there anything that I have not asked that you think is important to understanding GEAR UP/STAR 
implementation on your campus this year? 
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Students Training tor Academic Readiness (STAR) 
Partner Organization Interview -Summer 2011 


Partner Organization Name: 

Organization Representative Name: 

Job Title: 

Date: Interviewer: 

Representative’s years employed with partner organization: 

1. Involvement in Grant Planning 

a) Did you or your organization participate in developing any grant applications GEAR UP/STAR 
districts submitted to TEA for 2010-1 1 (year 5) funding? If yes. please describe your role in the 
process. ( Probe tor key contacts at each district.) 

b) Did you or anyone in your organization assist in the development of districts' implementation 
plans for 2010-11? This document is the implementation plan listing activities and timetables for 
year 5. and is based on the district's grant application as approved by the TEA. If yes. please 
describe which districts, and how you assisted them. ( Probe tor key contacts at each district.) 


2. Year 5 Implementation 

a) What were your organization's goals, key activities, and services offered for year 5 of the 
project? ( Probe for brief summary of goals.) 

b) What evidence do you have that these activities and services support college readiness, 
indirectly or directly? (Probe for research as well as anecdotal evidence.) 

c) Do you vary or modify your services and activities across districts? Why? 

d) What do you feel were your greatest successes in implementing your organization’s activities 
and services in year 5? 

e) What do you feel were your greatest challenges in implementing activities and services in year 
5? 

f) How wilVhave these challenges and successes inform your organization's approach to year 6 of 
the project? 

g) What are your goals for year 6 of the project? Do you have specific goals for any of the GEAR 
UP/STAR districts? ( Probe tor details where necessary.) 

h) Are you coordinating activities or services with other GEAR UPi'STAR partner organizations? 
Why or why not? ( Probe for key contacts at the coordinating partner organizations, and extent of 
any collaboration.) 


3. Other Issues 

Is there anything I haven't asked that you think is important in researchers' understanding of the 
GEAR UP/STAR project? 
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RECORD DESCRIPTIVE NOTES DURING OBSERVATION: 
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Appendix F 

STAR Goals and Objectives for the Statewide and District Programs 


GOAL 1: INCREASE THE NUMBER OF UNDERREPRESENTED (LOW-INCOME AND 
MINORITY) STUDENTS WHO ARE PREPARED TO GO TO COLLEGE. 

Objective 1 : By the end ot the project's first year, information, workshops, and student 
internship opportunities aimed at linking college attendance to career success will be available 
to 100% of the cohort students and their parents. 

Objective 2: By the end of the project's second year, at least 50% of the parents will have 
attended at least five college awareness activities. 

Objective 3: By the end of the project's third year. 50% of the middle school students in 
participating schools will be enrolled in pre-AP curriculum, including Algebra 1 and/or Spanish. 

Objective 4: By the end of the project's fourth year, at least 25% of the cohort will take an AP 
course as reflected on the Academic Excellence Indicator System. 

Objective 5: By the end of the project's fifth year, the number of students taking and passing 
AP examinations will meet or exceed the state average as reflected in the Academic Excellence 
Indicator System. 

GOAL 2: INCREASE THE NUMBER OF LIMITED ENGLISH PROFICIENCY (LEP) HISPANIC 
STUDENTS WHO SUCCESSFULLY GRADUATE AND ATTEND COLLEGE. 

Objective 1 : By the end of the project s first year, at least 50% of the parents of LEP students 
will be involved in college awareness activities. 

Objective 2: By the end of the project's third year. 30% of the LEP students will participate in 
pre-AP and AP courses: by the end of the fifth year, the number of LEP students in pre-AP and 
AP courses will meet or exceed the state average. 

Objective 3: By the end of the project's third year. 25% of LEP students will take AP Spanish in 
middle and high school to earn college credit before graduating. 

GOAL 3: STRENGTHEN ACADEMIC PROGRAMS AND STUDENT SERVICES AT 
PARTICIPATING SCHOOLS. 

Objective 1 : By the end of the project's first year, teams of teachers at the middle and high 
school will have participated in AP vertical’horizontal team training. 

Objective 2: By the end of the project's second year, at least 75% of the 8" grade students will 
be involved in a comprehensive mentoring, counseling, and/or tutoring program based on 
results of teacher/counselor input and diagnostic data. 

Objective 3: By the end of the project's fourth year. 50% of the students participating high 
schools will complete AP or concurrent enrollment credit. 

GOAL 4: BUILD AN ACADEMIC PIPELINE DESIGNED FROM SCHOOL TO COLLEGE. 

Objective 1 : Increase state commitment to building an academic pipeline designed to allow all 
students the opportunity to attend college. 





Objective 2: By the end ot the project's second year, at least 30% of the students will be 
involved in summer programs and institutes designed to help them with at or above grade level 
and to increase college awareness. 

Objective 3: By the end of the project's second year, all students and parents will have access 
to information about college, financial aid. and career requirements. 

GOAL 5: DEVELOP EFFECTIVE AND ENDURING ALLIANCES AMONG SCHOOLS. 
COLLEGES, STUDENTS, PARENTS, GOVERNMENT, AND COMMUNITY GROUPS. 

Objective 1 : By the end of the project's first year, existing school'colloge programs will be 
expanded by 25% and new programs will bo created. 

Objective2: By the end of the project's second year, counseling to parents and students will be 
available at Project STAR sites. 

Objective 3: By the end of the project's second year, all communities will have business 
alliances formed that support higher student achievement. 

Objective 4: By the end of the project's second year, participating campuses will have formed 
alliances with governmental entities and community groups enhance the information available 
on scholarships, financial aid. and college awareness. 

GOAL 6: IMPROVE TEACHING AND LEARNING. 

Objective 1 : By the end of the project's first year, teams of teachers at the middle and high 
school will have participated in AP verticat’horizontal team training. 

Objective 2: By the end of the project's second year, middle and high school teachers and 
counselors will be trained in effective data usage in planning individual student programs. 

Objective 3: By the end of the project's second year, all teachers will have the opportunity to 
participate in the University Fellows Program. 

GOAL 7: PROVIDE STUDENTS WITH INTENSIVE, INDIVIDUALIZED AND COORDINATED 
SUPPORT. 

Objective 1 : By the end of the project's second year. 75% of the students will have the 
opportunity to receive mentoring and/or tutoring services. 

Objective 2: By the end of the project's second year. 75% of the students will have the 
opportunity to receive counseling services as needed. 

GOAL 8: RAISE STANDARDS OF ACADEMIC ACHIEVEMENT FOR ALL STUDENTS. 

Objective 1 : By the end of the project's third year, at least 50% of the cohort will take pre-AP or 
AP courses. 

Objective 2: By the end of the project's fifth year. 50% of the students will score at or about the 
state average on the ACT/SAT. 

Objective 3: By the end of the project's fifth year, the number of students meeting criterion on 
the THEA will meet or exceed the state average. 
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Appendix H 

Implementation Analysis Scoring Rubric 
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Appendix I 

Advanced Course Performance Measures 


'Ihc STAR project strives to improve students* academic preparation for postsecondary education and to 
increase the number of students who pursue higher education opportunities. Over the course of the 
project, STAR districts are expected to increase the proportions of students who enroll in and complete 
AP and other rigorous coursework, graduate from high school, and enroll in college. This Appendix 
compares fourth year (2009-10), and in some eases fifth year (2010-1 1 ) data with baseline data (2005-06) 
across a variety of academic indicators that arc benchmarks against which districts’ progress toward 
STAR goals may be measured. Differences in data sources determine whether Year 4 or Year 5 results arc 
included in findings. Por indicators drawn from TEA data, such as the number of AP teachers working in 
schools or the percentage of students passing AP courses, data arc lagged a year, and therefore are limited 
to STAR’S fourth implementation year (i.c., 2009-10). However, indicators drawn from College Board 
data, such as AP exam participation and performance, were available through STAR’S fifth 
implementation year (i.c., 2010-11). Note that the data included in the appendix’s analyses reflect the 
performance of all students in STAR schools and are not limited to cohort student 

The appendix draws on data provided through TEA’S PEIMS and AE1S databases for the 2005-06 
through 2009-10 school years*'. Texas Higher Education Coordinating Board reports for the 2003-04 to 
2009-10 school years, as well as College Board reports for the 2005-06 through 2010-1 1 school years and 
includes measures related to enrollment in AP coursework. AP and college entrance examination scores, 
attendance rates, college readiness indicators, as well as graduation, dropout, and college enrollment rates. 
Results are reported across indicators for STAR districts and campuses and. where appropriate, for 
TEA-idcntificd “peer group” campuses,* 4 as well as state averages for purposes of comparison. 

Advanced Placement Program 

AP teachers. Table 1.1 shows that the number of AP teachers ranged from 3 to IX across STAR high 
schools in 2009-10, and that the number of AP teachers not changed considerably from the baseline year 
of 2005-06. 


* The most recent >ears for which data arc available. 

~ 4 For each campus in the state. TEA has created a peer or comparison group of 40 public school campuses selected 
on the basis of six student demographic characteristics, including the percentages of African American. Hispanic, 
and White students, the percentage of economically disadvantaged students, the percentage of limited English 
proficient students, and the campus mobility rate (2007 Accountability Manual. TEA). For a specific performance 
indicator. TEA reports the median value of the 40 comparison campuses on that indicator. Thus, peer groups allow 
for comparisons of campus performance for similar schools. 
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Table LI. Number of AP Teachers in STAR High Schools, 2005-06 through 2009-10 


Number of AP Teachers 


Campus 

2005-06 

(Baseline) 

2006-07 

2007-08 

2008-09 

2009-10 

Fa 1 lumas HS | 

4 

6 

6 1 

6 1 

6 

Alice HS I 

13 

12 1 

11 

To 

18 

H. M. King HS 1 

6 1 

6 ] 

4 i 

s 


Miller HS 

13 

14 

16 1 

14 i 

12 

Mathis HS 

2 

•m 

4 i 

5 

8 

Odem HS 1 

4 

4 

4 1 

4 ! 

3 

Total 

42 

44 

45 

44 

49 

Sources: 2005-06, 2006-0: 

\ 2007-08. 2008-09. and 2009-10 TEA siaft responsibi 

lilies tiles. 


AP courses. AP courses arc designed to prepare students for college level work and require sophisticated 
analysis of content, advanced reasoning and problem solving skills, as well as substantially more 
independent study. Relative to high school honors courses. AP courses arc expected to be more 
academically challenging and require a larger commitment from students in terms of the time and effort 
devoted to course work. Successful completion of AP coursework suggests that students have mastered 
rigorous course content and have the study skills and self-discipline required to master challenging 
college-level work. 


fable 1.2 reports the percentage of students in Cirades 9 through 12 at each STAR high school who 
received credit for AP coursework from 2005-06 (baseline year) through 2009-10. Across years, the 
largest percentages of students tended to take Knglish Language and Composition, linglish Literature and 
Composition. U. S. History. U. S. Government and Politics, and World History. Overall. STAR high 
schools experienced a 7 point increase in the percentage of students passing AP coursework. although 
results varied by campus. For example. Mathis High School increased the percentage of students passing 
at least one AP course from 7% in 2005-06 to 39% in 2009-10 (a gain of 32 percentage points). In 
contrast, the percentage of Odem High School students passing at least one AP course declined slightly 
from 12% in 2005-06 to 10% in 2009-10. 
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Table 12. Percentage of Students in tirades 9 Through 12 Who Received AP Course- 
Credit All STAR High Schools. 2005-06 Through 2009-10 (Continued) 


All STAR High Schools 

5 O O 

2 2$ 1 
8 35 

o 

o 

o 

o' 

1 1 

-t 

n 

O 

• 

N 

r-t 


o 

o’ 

o' 

C. 

o’ 


*r 


o 







So 

8 

ci 

3S 

o * 

<N 

<N 

o’ 

o’ 

>o 

o 

o’ 

■ 

o© 

O' 

o’ 

od 

<N 

— 

n 





o 

o’ 


o’ 


o 

o 

ac 

s: 

— 

*5 

— 

L 

o' 

o' 

s 












o 

o’ 

o' 



o 

o 


N 

o' 

o' 

o 

o 

o' 



I 








o 

o’ 

o’ 


o 

o 

o 

3 

8 t 

i; 

o’ 

o* 

o 

O* 

o 

o* 

5 

e # 



s 











s * 

3 o 

Q 

o 

o 


o 

o 

— 



00 

o’ 

I s : 



oo 

o 

— 

o. 

o 

o’ 

o 

Q 

o 

Q 

o 

ri 

— 

l 

0. 

< 

— 

a 

.2 

o 

S 

c_ 

< 

& 

a 

Cu 

< 

.3 

s. 

£ 

a. 

< 

< 

J 

1 

a. 

< 

O 

X 

s 

J 

£ 

a. 

< 

8 

I 

a. 

< 

1 

c3 

•a 

s 

a? 

UJ 

C- 

< 

O 

□ 

UJ 

Cu 

< 

— 

| 

s 

Cu 

< 

VI 

-I 

s 

a 

2 

ft 

2 

id 

> 

a 

p 

ft 

& 

.2 

*x 

vi 

b 

a. 

< 

— 

& 

! 

i 

X 

a. 

< 

& 

X 

2 

i 

a. 

< 

> 

i 

a 

j 

•£= 

£ 

c_ 

< 


> 

J 

1 

£ 

Z- 

< 

1 

1 

s 

a. 

< 

c 

=* 

I 

c 

c 

£ 

C 

r'i 

i 

a. 

< 

.1 

! 

.§ 

Q 

r+, 

i 

a. 

< 



268 


Sources: Student course completion records from TEA for 2005-06 through 2009-10. 






























































The characteristics of students who did and did not receive credit for at least one AP course in 20054)6 
(baseline year) and across STAR implementation years (2006-07 through 200X4)9) are compared in fable 
1.3. As indicated in the table, economic advantage is associated with AP program success — the majority 
of students who received credit for at least one AP course did not qualify for free- or reduced-price 
lunches. In addition, females were more likely than males to receive credit for an AP course. 


269 




270 













Advanced Placement (AP> Examinations. In May of each year, students who have completed AP 
classes may take national AP examinations prepared by the College Board. 'Ihesc examinations are 
offered in over 30 content areas in 16 disciplines. They contain both multiple-choice questions and free 
response items that require students to write essays, solve problems, and demonstrate other advanced 
skills. The examinations include Art. Art History. Studio Art. Biology. Chemistry*, Computer Science, 
Economics, English (Language and Composition. Literature and Composition), Environmental Science, 
French, German, Government and Politics (Comparative, U.S.). History (European. U.S., and World), 
Latin. Calculus. Statistics. Music Theory, Physics. Psychology, and Spanish (Language. Literature). 

In June, college and secondary school teachers score the examinations, and in July, students receive 
scores. AP examinations arc scored using a 5-point scale: 

• 5 = extremely well qualified. 

• 4 = well qualified. 

• 3 = qualified. 

• 2 = possibly qualified, and 

• l = no recommendation. 

Individual colleges decide which AP examination scores they will accept in return for course credit or 
advanced placement. 

Figure 1.1 presents information on AP examination participation in STAR high schools from 2006 to 
201 1 . While the number of AP test takers and exams taken declined from 2006 to 2009, high schools saw 
a notable increase in the number of test takers and exams taken in 2010 when the first cohort of STAR 
students (i.c.. Grade 7 students in 2006-07) were in Grade 10. 



Figure 1.1. AP examination participation at STAR high schools. 2005-06 through 2010-11. 

Sources: College Board Advanced Placement Examination Perfomiance and Participation Overview reports for 
2005-06. 2006-07. 2007-08. 2008-09. 2009-10. and 2010-11. 
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Also reported in Table 1.4 presents information on the number of test takers, tests taken, and the 
percentage of exams earning a score of 3 to 5 for the 2005-06 through 2010-1 1 school years and the 
percentage of growth (or dcclinc)for each STAR high school, for all Texas public schools, and all public 
schools nationally. The table indicates that most STAR high schools increased the number of students 
who took tests at a rate that was greater than the national average (54% vs. 50%). but which lagged the 
state average (63%). In terms of the number of tests taken. STAR high schools (49%) lagged the average 
rate of increase of both Texas (63%) and the nation (52%). While overall trends indicate declines in the 
percentage of AP exams earning a score of 3 or better across years, the rate of decrease in STAR high 
schools (-54%) substantially exceeded those of state (-7%) and the nation (-3%). The size of rate changes 
at STAR high schools is largely the result the small number of students they enroll relative to the state or 
the nation. Figure 1.2 depicts the decreasing rates in the percentage of AP exams earning a 3 or better 
across years. Although the average decrease for STAR schools is greater than that of Texas and the 
nation, overall, decreases arc small. 
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Table 1.4. AP Examination Performance of STAR High School*. 2005-06 Through 20 10- 11 
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—♦—STAR Campuses -*-Tcxas — All Public Schools 


Figure 1 . 2 . Percentage of AP examination scores earning a 3 or higher. 2006 through 2011. 

Sources: College Board 2005-06. 2008-09. 2009-10. and 2010-11 School Integrated Summary Reports; and 2006-07 
and 2007-08 District Integrated Summary reports. 


Table 1.5 rcpotls the number of specific AP examinations taken and the percentage having scores of 3 or 
above aggregated across STAR high schools for the 2005-06 through 2010-1 1 school years. Result arc 
masked for exams taken by fewer than five students. In 2010-1 1, the largest proportion of AP exam takers 
to receive a score of 3 or better took the Spanish Language test (23%). Although more students took the 
Lnglish Language and Composition test (220 vs. 48 for Spanish Language), a smaller proportion of these 
students earned a score of 3 or better (8.2%). 
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* In 2006-07. 2007-08. 2008-07. 2009-10. and 2010-1 1 stores arc nol reported when there arc fewer than 5 examinations. Table C 

''Includes numbers that were masked in the rows above. 



Table 15. STAR AF Examination Scores. 2005-06 Through 2010-1 1 (Continued) 

2009-10 

N Scores 3. 4. or 5 N 
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ATTENDANCE RATES 


Regular school attendance is necessary for academic achievement. Attendance rates arc indicators of 
students* commitment to learning as well as the ability of the school to meet students* academic needs. 
Figure 1.3 shows the average attendance rates for all STAR campuses from 2005-06 (baseline) through 
2009-10. Also shown arc peer campus attendance rates along with state averages. Although STAR 
attendance rates have generally improved across years they remained somewhat lower than both peer 
campuses and the state average in 2009-10. 


Table 1.6. Attendance Rates of STAR Schools. 2005-06 Through 2009-10 


Group 


2005-06 

2006-07 

2007-08 

2008-09 

2009-10 

2006-10 

Change 1 ' 

Junior High 

Falfumas JH 

91.6% 

92.2% " 

91.8% 

93.3% 

93.8%’ 

-2.2 

and Middle 

Adams MS 

91.6% 

91.1% 

92.1% 

91.3% 

91.4% 

-0.2 

Schools 

Memorial MS 

92.5% 

92.9% 

92.2% 

92.8% 

92.0% 

-0.5 


Driscoll MS 

93.6% 

93.9% 

94.2% 

94.8% 

94.7% 

+1.1 


Mathis MS 

94.6% 

95.4% 

95.0% 

95.2% 

94.3% 

-0.3 


Odcm JH 

97.0% 

96.4% 

95.8% 

96.2% 

96.0% 

-1.0 


Group 

Average* 

93.5*% 

93.7% 

93.5% 

93.9% 

93.7% 

+0.2 


Group Peer 
Campuses* 

95.6% 

95.8% 

95.8% 

95.7% 

95.6% 

0.0 

High Schools 

Falfumas HS 

90.0% 

92.4% 

87.9% 

92.7% 

92.1% 

+2.1 


Alice HS 

89.3% 

89.5% 

89.7% 

89.8% 

90.0% 

+0.7 


H. M. King IIS 
Miller HS 

92.0% 
90 tS% 

92.9% 
90 6% 

93.1% 
xu 2% 

92.6% 

93 

91.5% 

93 3% 

-0.5 


Mathis HS 

92.7% 



89.4% 

91.7% 

90.7% 

92.0% 

mmmmf 

-0.7 


Odcm HS 

95.5% 

95.7% 

— 

95.4% 

95.0% 

94.4% 

-1.1 


Group 

Average* 

91.7% 

91.8% 

91.2% 

92.3% 

92.2% 

+0.5 


Group Peer 
Campuses* 

93.8% 

93.7% 

93.6% 

93.7% 

93.6% 

-0.2 


STAR 

Average* 

92.6% 

92.7% 

92.3% 

93.1% 

93.0% 

+0.4 


All Peer 
Campuses* 

94.7% 

94.7% 

94.7% 

94.7% 

94.6% 

-0.1 


State Average 

95.5% 

95.5% 

95.5% 

95.6% 

95.5% 

0.0 


Sources: STAR and peer data are from 2006-07 through 2010-1 1 Academic Excellence Indicator System (AE1S) 
campus non-TAKS performance indicators data files. State data are from 2006-07 through 2010-1 1 AEIS State 
Performance Reports. 

'Simple average. 

^Change in percentage points. 
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Figure I J. Attendance rates of all STAR campuses. 2006 Through 2010. 

Sources: STAR and peer daia are from 2006-07 through 2010-1 1 Academic Excellence Indicator System (AEIS) 
campus non-TAKS performance indicators data files. State data are from 2006-07 through 2010-11 AEIS State 
Performance Reports. 


GRADUATION RATES AND OTHER MEASURES OF ACADEMIC PERFORMANCE 


Graduation rates, advanced course completion rates, and Recommended High School Program' 
Distinguished Achievement Program (RHSP/DAP) completion rates arc also indicators of high school 
student and campus academic performance. Table 1.7 presents 2005-06 through 2009-10 information on 
these measures for STAR high schools with comparison data provided for peer campuses and the state as 
a whole. The STAR graduation rate increased by about five percentage points (i.c., from 77% to 82%) 
across this period: however, Mathis High School increased its graduation rate by more than 22 percentage 
points (i.c., from 70% to 92%). Overall, the average increase in graduation rates for STAR high schools 
were similar to those of peer comparison campuses and the state (a four percentage point increases for 
both).. 
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Tabic 1.7. Graduation Rales, Recommended High School Program/Distinguished Achievement 
Program (RHSP/DAP) Completion Rates, and Advanced Course Completion Rates of STAR 
High Schools, 2005-06 through 2009-10 









2006-10 

Group 


2005-06 

2006-07 

2007-08 

2008-09 

2009-10 

Change 1 ' 

Graduation 

Falfumas HS 

87.1% 

81.4% 

84.7% 

88.4% 

89.4% 

*2.3 

Rate 

Alice HS 

67.3% 

58.6% 

59.3% 

61.8% 

66.3% 

-1.0 


H. M. King HS 

77.3% 

71-1% 

68.4% 

72.1% 

80.9% 

-3.6 


Miller HS 

73.3% 

63.7% 

68.8% 

68.8% 

76.0% 

*2.7 


Mathis HS 

70.2% 

81.2% 

94.5% 

84.7% 

92.4% 

+22.2 


Odcm IIS 

88.5% 

80.7% 

87.5% 

76.9% 

86.5% 

-2.0 


Group 

Average* 

77 J% 

72.8% 

77.2% 

75.5% 

81.9% 

+4.6 


Peer 

Campuses* 

80.5% 

78.0% 

79.7 % 

80.7% 

84.9% 

+4.4 


State Average 

80.4% 

78.0% 

79.1% 

80.6% 

84.3% 

+3.9 

RHSP/DAP 

Falfumas HS 

70.0% 

74.5% 

75.4% 

73.8% 

89.3% 

+ 19.3 

Completion 

Alice HS 

92.7% 

93.9% 

91.4% 

95.0% 

85.9% 

-6.8 

Rate 

H. M. King IIS 

86.7% 

84.6% 

90.5% 

89.6% 

89.7% 

+3.0 


Miller HS 

67.6% 

67.7% 

70.9% 

81.3% 

87.9% 

+20.3 


Mathis IIS 

87.6% 

93.8% 

87.1% 

94.8% 

91.3% 

+3.7 


Odcm HS 

76.1% 

73.6% 

82.2% 

88.5% 

89.7% 

+13.6 


Croup 

Average' 

80.1% 

81.4% 

82.9% 

87.2% 

89.0% 

+8.9 


Peer 

Campuses* 

84.2% 

85.5% 

87.1% 

88.3% 

88.8% 

+4.6 


State Average 

75.7% 

77.9% 

81.4% 

82.5% 

82.7% 

+7.0 

Advanced 

Falfumas HS 

12.7% 

17.5% 

14.6% 

21.0% 

33.2% 

+20.5 

Course 

Alice IIS 

20.4% 

21.0“/. 

21.3% 

23.9% 

30.8% 

+ 10.4 

Completion 

Kate 

H. M. King IIS 

14.7% 

15.7% 

14.4% 

18.4% 

17.3% 

+2.6 

Miller HS 

17.4% 

19.6% 

19.8% 

16.8% 

20.4% 

+3.0 


Mathis IIS 

10.8% 

8.6% 

14.5% 

25.7% 

52.4% 

+41.6 


Odcm HS 

14.0"/; 

16.2% 

19.0% 

24.8% 

19.7% 

+5.7 


Group 

Average* 

• 

15.0% 

16.4% 

17.3% 

21.8% 

29.0% 

+14.0 


Peer 

Campuses* 

17.8% 

18.1% 

19.9% 

20.9% 

25.1% 

+7J 


State Average 

21.0% 

22.1% 

23.1% 

24.6% 

26.3% 

+5.3 


Sounres: STAR and peer data are from 2006-07 through 2010-1 1 Academic Excellence Indicator System 
(APIS) campus completion rates and campus non-TAKS performance indicators data files. State data are 
from 2006-07 through 2010-11 APIS State Performance Reports. 

"Simple average. 

*Cliange in percentage paints. 
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Another measure of academic readiness is the RHSP/DAP completion rate. The RHSP requires 24 credits 
and more rigorous elective courses (c.g.. fine arts, languages other than English) than the 22-crcdit 
minimum graduation plan. The DAP requires completion of RHSP requirements plus one additional 
credit in a foreign language and any combination of four advanced measures (c.g.. a 3 or higher on an AP 
examination, a grade of 3.0 or higher on courses that count for college credit, an original, judgcd.-rcscarch 
project, and a score on the PSA F that qualifies the student for recognition). Compared to the baseline year 
of 2005-06. there was a 9 point increase in the percentage of students in STAR schools who completed 
the RHSP/DAP in 2009-10. This increase exceeded gains for both peer campuses and the state average. In 
addition, compared to the state average, a higher percentage of students in STAR schools completed the 
RHSP/DAP in 2008-09 (89% vs. 83%). 

Advanced course completions arc another measure of rigorous academic preparation. Advanced courses 
include AP and IB courses along with higher-level core content area courccs (c.g.. pre-calculus, 
research-technical writing, economics advanced studies), advanced elective courses (c.g., French IV. 
Iheatrc Arts IV', Music IV Ja xi Band), and dual enrollment courses for which a student gets both high 
school and college credit. Advanced course completion rates in STAR high schools were 14 percentage 
points higher in 2009-10 than in 2005-06 (29% vs. 15%). with the greatest gains occurring at Mathis High 
School (an increase of 42 percentage points). Gains for STAR high schools exceeded those of both peer 
campuses and the state. STAR high school students had greater advanced course completion rates than 
peer campuses (29% vs. 25%) and the state (29% vs. 26%). 

COLLEGE ENTRANCE EXAMS 

College entrance examination scores for both the SAT and ACT arc reported to TEA. TEA includes the 
percentage of students taking the examinations, the average examination scores, and the percentage of 
students scoring at or above the criterion ( 1 1 10 on the SAT and 24 on the ACT) in AEIS reports. Data are 
reported when students arc scheduled to he seniors, regardless of when they took the examinations. 

Table 1.8 presents college entrance examination data for STAR high schools, peer campuses, and state 
averages. Data were gathered from the 2006-07 through 2010-1 1 AEIS files, but reported results arc for 
the 2005-06 through 2009-10 school years. Between 2006 and 2010. the percentage of students in ST AR 
schools taking college entrance examinations decreased by 7 percentage points. Across the same time 
period, the rate of peer campus students participation in exams remained largely unchanged and the state 
rate declined by about 3 percentage points. However, compared to peer campus and state averages, the 
percentage of students in STAR schools taking college entrance examinations was higher than both 
comparison groups for each testing year (sec Figure 1.4). While participation in college entrance exams 
was greater at STAR campuses, the percentage of students scoring at or above the criterion similar to peer 
campus averages, hut considerably lower than the state averages. 

From 2006 through 2010. ACT average scores were generally stable for STAR and peer campuses and 
the state average. STAR campuses' average ACT scores were lower than the averages of both peer 
campuses and the state (see Figure 1.6). However. STAR high schools improved their average SAT scores 
over the same time period. In 2005-06. students at STAR high schools earned an average SAT score of 
896. In 2010. the average SAT score increased by 23 points to 919. This increase exceeds that of peer 
campuses (an average increase of 6 points), and average scores at the state level declined over the period. 
Despite this trend, average SAT scores at STAR high schools still lagged the state average in 2009-10 
(919 vs. 985) (sec Figure 1.5). 
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Tabic 1.8. College Entrance Examination Performance of STAR High Schools, 2005-06 Through 
2009-10 


Group 

2005-06 

2006-07 

2007-08 

2008-09 

2009-10 

2006-10 

Change 

Percent Taking Falfurrias IIS 

b 1 ■ ■ 

67.1% 

72.8% 

64.0% 

49.3% 

74.4% 

+7.3 

Exams Alice IIS 

90.3% 

86.7% 

83.2% J 

83.6% 

712% 

-19.1 

H. M. King IIS 

75.7% 

76.0% 

76.4% 

60.3% 

62.9% 

-12.8 

Miller HS 

77.1% 

73.4% 

64.5% j 

57.8% 

50.8% 

-26.3 

Mathis HS 

70.9% 

64.4% 

55.2% 

63.1% ~ 

80.0% 

+9.1 

Ode m HS 

77.6% 

75.9% 

83.9% 

96.2% 

78.6% 

+1.0 

Group Average* 
Peer Campuses' 

76.5% 

65.5% 

74.9% 

68.7% 

71.2% 

64.2% 

68.4% 

63.7% 

69.7% 

65.4% 

-6.8 

41.1 

State Average 

65.8% 

68.2% 

65.0% 

61.5% 

62.6% 

-3.2 

Percent at or Falfurrias IIS 

2.0% 

11.9% 

3,1% | 

5.7% 

1.6% 

-0.4 

Above ^ Alice HS 

Criterion ii v« k j-w, «i« 

7.4% 

1 1 4% 

9.2% 
1 1 0% 

11.2% j 
1 1 8% 

1 1.2% 
15 8«:. 

6.9% 
18 2% 

-0.5 
*6 8 

Miller HS 

3.9% 

6.5% 

1.8% 

2.4% 

1.6% 

-2.3 

Mathis HS 

8.2% 

8.9% 

6.3% 1 

■ | 

1.5% 

2.6% 

-5.6 

Odem HS 

11.1% 

2.3% 

3.8% 

6.0% 

9.1% 

-2.0 

(■roup Average d 
Peer Campuses" 
State Average 

7.3% 

8.5% 

27.1% 

8.3% 

7.9% 

27.0% 

6.3% 

8.7% 

27.2% 

7.1% 

9.2% 

26.9% 

6.7% 

8.9% 

26.9% 

41.6 

+0.4 

41.2 

ACT Average* Falfurrias HS 

16.4 

18.4 

17.2 

18.0 

16.6 

*0.2 

Alice HS 

17.7 

17.5 

18.6 

18.5 

17.4 

4>.3 

H. M. King HS 

18.0 

18.4 

19.0 

18.1 

19.4 

+ 1.4 

Miller HS 

158 

16.2 

16.1 

16.9 

16.0 

+02“ 

Mathis HS 

16.2 

16.8 

16.6 

15.1 

16.2 

0.0 

Odem HS 

18.2 

17.3 

17.6 

17.6 

17.7 

-0.5 

Group Average 

17.1 

17.4 17.5 17.4 17.2 

+0.1 

Peer Campuses' 1 

18.1 

17.8 

18.0 

18.1 

18.1 

0.0 

State Average 

20.1 

20.2 

20.5 

20.5 

20.5 

+0.4 

SAT Average 1 Falfurrias HS 

857 

979 

806 

937 

Mask 

Mask' 

Alice HS 
H. M. King HS 

918 

910 

1049 

891 

1065 

899 

961 

965 

1062 

919 

+ 144 
♦9 

Miller HS 
Vl vthiw' IIQ 

794 

inn 

864 

794 

\4%eLr 

805 
Nil i.i 

807 

+ 13 
Mast* 

.•liiiiin i i.i 

Odem HS 

IU1 J 

885 

870 

AKINK 

893 

962 

IVldAA 

888 

AldSK 

+3 

Group Average 4 

896 

931 

891 

926 

919 

+23 

Peer Campuses' 1 

894 

898 

888 

903 

900 

+6 

State Average 

991 

992 

987 

985 

985 

-6 


Sources: STAR and peer data are from 2006-0? through 2010-1 1 Academic Excellence Indicator System (AF.IS) 
campus college and admission rate statistics data files. State data are from 2006-07 through 2010-11 AEIS State 


Performance Reports. 

'Data are masked. The denominator is less titan 5 (ineluding 0). 
'Changes in percentage points 
'Changes in average test scores 
''Simple average. 
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Figure 1.4. Percentage of students taking college entrance examinations (SAT or ACT), 2006 
through 2010. 

Sources: STAR and peer data are from 2006-0? through 2010-11 Academic Excellence Indicator System (AEIS) 
campus college and admission rate statistics data files. State data are from 2006-0? through 2010-1 1 AEIS State 
Performance Reports. 



Figure 1.5. Average performance on SAT college entrance examination (criterion score is 1100). 

2006 through 2010. 

Sources: STAR and peer data arc from 2006-07 through 2010-11 Academic Excellence Indicator System (AEIS) 
campus college and admission rate statistics data files. State data arc from 2006-07 through 2010-1 1 AEIS State 
Performance Reports. 
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2006 2007 2008 2009 2010 


STAR Campuses -®— Peer Campuses * Slate Average Criterion Score 


Figure 1.6. Average performance on ACT college entrance exam (criterion score is 24), 2006 
through 2010 . 

Sources: STAR and peer data are from 2006-07 through 2010-11 Academic Excellence Indicator System (AEIS) 
campus college and admission rate statistics data files. State data ate from 2006-07 through 2010-H AEIS State 
Performance Reports. 

COLLEGE READINESS 

In 2007, AEIS introduced an indicator of college readiness, the percentage of college-ready graduates. 
This indicator is a measure of preparation for postsccondary success. To be considered college ready as 
defined by this indicator, a graduate must have met or exceeded specified criteria on the exit-level TAKS 
test, the SAT. or the ACT. These criteria arc listed in fable 1.9. 


Table 1.9. College- Readiness Indicators and Criteria for the Class of 2006. 2007. 2008. 2009. and 
2010 


Subject 

Exit-level TAKS 


SAT 


ACT 

ELA 

>= 2200 scale score on 

OR 

>=500 on 

OR 

>= 19 on English 


ELA test 


Critical Reading 


AND 


AND 


AND 


>= 23 Composite 


a *'3** or higher on the essay 


>=1070 Total 



Mathematics 

>= 2200 scale score on 

OR 

>=500 on Math 

OR 

>= 19 on Math 


mathematics test 


AND 


AND 




>=1070 Total 


>= 23 Composite 


Source: TF.A AEIS Cilossary for 2006-07. 2007-08. 2008-09. 2009-10. 2010-11. 










As Tabic 1.10 indicates, the percentages of STAR high school graduates who were college ready 
increased from 2006 to 2010 (by 4 percentage points in mathematics. 16 percentage points in reading, and 
by 9 percentage point in both subjects). Gains in the percentage of college-ready graduates for both peer 
campuses and the state were greater mathematics, reading, and both subjects (see Figure 1.7.) In 
mathematics, the percentage of 2009-10 STAR high school graduates who were college ready (43%) was 
lower than the state average (64%) and the peer campus average (53%). In reading, the percentage of 
2009-10 graduates from STAR schools who were college-ready (60%) was lower than the state average 
(66%) but higher than the peer campus average (57%). In both subjects, the percentage of graduates from 
STAR schools who were college-ready (33%) was lower than averages for the state (52%) and peer 
campuses (40%). 



Figure 1.7. Percentage of graduates college ready in both reading and mathematics, 2006 through 
2010. 

Sources: STAR and peer data ate from 2006-07 through 2010-1 1 Academic Excellence Indicatoi System (AE1S) 
campus college and admission rale slatislics data files. Stale data are from 2006-07 tluough 2010-11 AhlS Slate 
Performance Reports. 
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Tabic 1.10. College Readiness Indicators by Comparison Croup. 2005-06 Through 2009-10 

: j i 2006-10 

Group 2005-06 2006-07 2007-08 2008-09 2009-10 Changc b 


College 

Ready 

Falfurrias HS 
Alice HS 

37% 

38% 

€ £ 
rf c^i 

55% 

50% 

45% 

57% 

36% 

49% 

-1 

+11 

Mathematics 

II. M. King IIS 

41% 

49% 

55% 

47% 

52% 

+11 


Miller HS 

36% 

44% 

43% 

39% 

39% 

+3 


Mathis HS 
Odcm HS 

39% 

4’% 

30% 

32% 

44% 

34% 

5’% 

30% 

53% 

-9 
+ 11 


Group 

Average* 

39% 

40% 

47% 

46% 

43% 

+4 


Peer 

Campuses* 

38% 

43% 

46% 

48% 

53% 

+15 


State Average 

52% 

56% 

58% 

60% 

64% 

+12 

College 

Falfurrias HS 

44% 

70% 

58% 

57% 

53% 

+9 

Ready 

Alice HS 

60% 

56% 

■ ■■■■■ ■ ■ i 

71% 

■ ■ ■ ■ ■ 

72% 

69% 

■ 

+9 

Reading 

H. M. King IIS 

68% 

64% 

71% 

73% 

80% 

+ 12 


Miller HS 

30% 

30% 

36% 

46% 

42% 

+ 12 


Mathis HS 

21% 

28% 

34% 

44% 

66% 

+45 


Odcm HS 

39% 

31% 

49% 

56% 

50% 

+ 11 


Group 

Average* 

44% 

47% 

53% 

58% 

60% 

+16 


Peer 

Campuses* 

35% 

38% 

51% 

54% 

57% 

+22 


State Average 

48% 

49% 

59% 

62% 

66% 

+18 

College 

Falfurrias HS 

26% 

41% 

28% 

37% 

24% 

-2 

Ready Both 

Alice HS 

29% 

29% 

34% 

51% 

43% 

+ 14 

Subjects 

H. M. King HS 

32% 

36% 

33% 

41% 

48% 

+ 16 


Miller HS 

16% 

18% 

28% 

28% 

24% 

+8 


Mathis HS 

12% 

13% 

30% 

20% 

25% 

+ 13 


Odcm HS 

28% 

10% 

35% 

37% 

36% 

+8 


Group 

Average* 

— 

24% 

25% 

34% 

36% 

33% 

+9 


Peer 

Campuses' 

20% 

22% 

31% 

35% 

40% 

+20 


State Average 

35% 

37% 

44% 

47% 

52% 

+17 


Sources: STAR and peer data are from 2006-07 through 2010-1 1 Academic Excellence Indicator System (AEIS) 
campus college and admission rate statistics data fdes. State data are from 2006-07 through 2010-1 1 AEIS State 
Peifoimance Reports. 

‘Simple average. 

"Change in percentage points. 

ADDITIONAL CAMPUS OUTCOME MEASURES 

The General Educational Development (GED) attainment rate is calculated by dividing the number of 
students in a particular cohort who received a GED by the number of students in the cohort. T he Grades 9 
through 12 dropout rate is calculated by dividing the number of dropouts in tirades 9 through 12 in a 
particular school year by the number of Grades 9 through 12 students who were in attendance at any time 
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during that school year. Both GED and Grades 9 through 12 dropout rates arc additional indicators of 
student and campus performance. Table 1.1 1 reports longitudinal data on these indicators for STAR high 
schools as well as for peer campuses and the state. 

Average STAR GED completion rates exceeded peer campus rates from 2006 through 2010 and exceeded 
state rates in 2007 through 2010. although overall, STAR high schools have experienced a slight decrease 
(0. 1 percentage point decrease) in GED completion rates from 2006 through 2010. Over the same period, 
peer campus and state rates also decreased (a 0.4 percentage point decrease for peer campuses and a 1 .0 
percentage point decrease for the state). From 2006 through 2010. the average STAR Grades 9 through 12 
dropout rate exceeded the peer campus rate and the state average. Yet the decrease in the Grades 9 
through 12 dropout rate at STAR campuses (2. 1 percentage point decrease) exceeded the decrease at peer 
campuses (2.0 percentage point decrease) and at the state level (1.3 percentage point decrease). 


Table 1.1 1. GED Completion Rates and Dropout Rates of STAR High Schools, 2005-06 Through 
2009-10 









2006-10 

Group 


2005-06 

2006-07 

2007-08 

2008-09 

2009-10 

Change 1 ' 

GED 

Falfurrias HS 

0.0% 

0.0% 

2.3% 

0.0"/. 

0.0% 

0.0 

Completion 

Kate 

Alice HS 
H yi Kin- HS 

2.9% 
i 0% 

4.9% 
4 1% 

3.9% 
3 7% 

6.5% 
» O'/. 

3.8% 
1 8% 

>0.9 
-1 ’ 


Miller HS 

2.1% 

■ 

3.7% 

2.7% 

4.0"/. 

3.8% 

+1.7 


Mathis HS 

2.5% 

0.0"/. 

0.0"/. 

4.6% 

1.7% 

-0.8 


Odcm HS 

1.3% 

1.1% 

•i — ■ — ■ - 

0.0% 

0.0% 

0.0% 

-1.3 


Group Average* 

2.0% 

2.3% 

2.1% 

2.8% 

1.9% 

-0.1 


Peer Campuses* 

\A% 

1.1% 

1.0% 

1.1% 

1.0% 

-0.4 


State Average 

2.3% 

2.0% 

1.5% 

1.4% 

1.3% 

-1.0 

tirades 9-12 

Falfurrias HS 

1.7% 

4.6% 

1 .7% 

msm 

msm 


Dropout 

Kate 

Alice HS 
H. M. Kirn- HS 

9.3% 

6.0"/. 

11.2% 

7.1% 

9.0% 

0.6% 


pa 



Miller HS 

9.3% 

9.4% 

5.5% 

3.9% 

■ — ■ I* 

1.8% 

-i . ... — - i ■ ■ ■ « 

-7.5 


Mathis HS 

1.3% 

0.3% 

0.8% 

3.7% 

i lj 

1.0% 

- — - j] 

-0.3 


Odcm HS 

2.8% 

3.9% 

4.0% 

2.4% 

4.1% 

+1.3 


Group Average* 

5.1% 

6.1% 

3.6% 

3.6% 

3.0% 

-2.1 


Peer Campuses* 

3.7% 

3.8% 

2.9% 

2.6% 

1.7% 

-2.0 


State Average 

3.7% 

3.9% 

3.2% 

2.9% 

2.4% 

-1.3 


Sounds: STAR and peer data are from 2006-07 tlvough 2010-11 Academic Excellence Indicator System (AEIS) 
campus completion rates (GED completion rate) and campus non-TAKS performance indicators (Grades 9-12 
dropout rate) data files. State data are from 2006-07 through 2010-11 AEIS State Performance Report*. 

"Simple average. 

*C!ange in percentage points. 
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ENROLLMENT IN HIGHER EDUCATION 


STAR seeks to increase the number of high school graduates who enroll in postsccondary educational 
programs. Thus, higher education enrollment rates arc a key indicator of STAR’S success. Table 1.12 and 
Figure 1.8 present data on the percentages of graduates from STAR campuses who entered Texas 
universities and community colleges or vocational programs. Information is presented for 3 years prior to 
project implementation <2004 through 2006) and for 4 years following project implementation (2007 
through 2010). In 2010. 49% of graduates from STAR schools entered a postsccondary educational 
program in Texas — 28% enrolled in a 4-ycar university and 21% enrolled in a community college or 
technical school. For each reported year, more than 45% of graduating seniors could not be located. These 
students may have enrolled in programs outside of Texas, delayed their enrollment, or chosen to forgo 
postsccondary education. 

Compared with the baseline year of 2006, there was a decrease in the percentage of graduates from STAR 
schools entering a 4-ycar university (a 1 percentage point decrease), but an increase in the percentage of 
graduates who entered a community college or technical school (a 3 percentage point increase) in 2010. 
Overall. STAR high schools have seen a slight increase (2 percentage points) in the percentage of 
graduates enrolling in higher education in Texas. 
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Table 1.12. (Graduates from STAR Schools Entering Higher Education in Texas. 2004-2010 


High School 
Alice HS 

2004 

University 
N Percent 

107 24.5% ] 

Community.'Tcch 
N Percent 

63 20.3% 

Total 

N Percent 

170 54.8% | 

Not Located 
N Percent 

140 45.2% 

2005 

73 

30.0% 

49 

20.2% , 

122 

50.2% | 

121 

49.8% 

2006 

92 

- - i | 

35.3% i 

45 

■ - — t 

17.2% 

■ ■ 1; 

137 

52.5% ' 

— — - | 

124 

47.5% 

2007 

81 

30.8% i 

59 

22.4% 

— ■ ■ i ' ~ 

140 

53.2% | 

■ — . - || 

123 

46.8% 

2008 

85 

34.7% 

: 

59 

24.2% j 

144 

59.0% | 

100 

41.0% 

2009 

87 

36.4% j 

63 

26.4% 

150 

62.8% 1 

89 

37.2% 

2010 

Falfurrias HS 

81 

27.8% 

78 

26.8% 

159 

54.6% 

132 

45.4% 

2004 

■ ■ ■ ■ { 

30 

27.8% ] 

20 

18.5% j 

50 

46.3% j 

58 

- ■ ■ 1* 

53.7% 

2005 

33 

36.3% 

5 

5.5% 

38 

41.8% i 

53 

58.2% 

2006 

1 

27 

30.0% ! 

18 

20.0% 

45 

50.0% ; 

45 

50.0% 

2007 

— — - f 

28 

- — — - — 1; 

29.8% 

22 

- ■— — - ■ — - II 

23.4% 

|| 

50 

53.2% 

■ — - . — — — .|| 

44 

46.8% 

2008 

20 

16.9% 

26 

22.0% 

46 

39.0% . 

72 

61.0% 

2009 
11 1 I II 

17 

07 

20.2% 
9fi 9°/« 

22 

97 

26.2% | 
9C ow 

39 

46.4% ] 

45 

dQ 

53.6% 

<17 A 0 /. 

-U 1 U 

H. M. King HS 

C 1 

cU.c Jo 




Jc.l JO 

••7 

f .o 'O 

2004 

134 

55.8% | 

20 

8.3% 

154 

64.2% j 

86 

35.8% 

2005 

104 

44.1% 1 

22 

- - 4: 

9.3% 

■ - ■ ■ ■ — — . ; 

126 

53.4% ~ 

— p— — ■— ■ i — -i|i 

110 

46.6% 

2006 

91 

44.2% 

14 

- ■ — — - |i 

6.8% 

■ ■ ■ | 

105 

51.0% : 

■ ■ |j 

101 

49.0% 

2007 

96 

49.5% j 

24 

12.4% | 

120 

61.9% | 

74 

38.1% 

2008 

87 

43.9% : 

29 

14.6% 

116 

58.6% 

82 

41.4% 

2009 

106 

48.2% ; 

37 

16.8% i 

143 

65.0% | 

77 

35.0% 

2010 

99 

42.9% 

29 

12.6% 

128 

55.4% 

103 

44.6% 

Mathis HS 

2004 

14 

|| 

13.7% j 

31 

- 

30.4% 1 

■ i ■ ■ . Jt 

45 

44.1% | 

- ... |j 

57 

■ — |i 

55^9%" 

2005 

18 

19.6% | 

25 

27.2% ] 

43 

46.7% | 

49 

53.3°% 

2006 

11 

11.3% j 

27 

27.8% 1 

38 

39.2% i 

59 

60.8% 

2007 

21 

21.9% 

19 

19.8% ; 

40 

41.7% 

56 

58.3% 

2008 

18 

17.8% ! 

18 

17.8% ! 

36 

35.6% 1 

65 

64.4% 

2009 

2010 

Miller HS 

2004 

27 

21.6% j 

IQ 

28 

Of\ 

22.4% 

17 

55 

AO 

44.0% j 
QC fW- 

70 

79 

56.0% 

CiO 00/ 

51 

1 7.W JO 

16.4% 1 

44 

14.1% 1 

|| 

95 

sJU.O JO 

30.5% 1 

■ — — — J 

1 4- 
216 

uox to 

69.5% 

2005 

44 

■ ■ — — ■ .1! 

17.6% i 

50 

- — - .... - .11 

20.0% 

■ - - - — |j 

94 

- - ■ — - r. 

37.6%, I 

■ ■ - |j 

156 

- |] 

62.4% 

2006 

38 

14.5% j 

61 

23.3% ] 

99 

37.8%, | 

163 

62.2% 

2007 

35 

15.3%, 1 

60 

26.2% 

95 

41.5%, 

134 

58.5% 

2008 

23 

— - — - — ■ |j 

9.7% 

61 

25.7% j 

84 

35.4"/. j 

153 

64.6% 

2009 

■ ■ |i 

39 

- i || 

18.7% 

58 

27.8% 

97 

46.4% I 

112 

53.6% 

2010 

21 

12.4% 

36 

21 .3% 

57 

33.7% 

112 

66.3% 


Table Continues 
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Tabic 1.12. (Graduates from STAR Schools Entering Higher Education in Texas. 2004-2010 
(Continued) 



University 

Community/Tcch 

Total 

Not Located 1 

High School 

N 

Percent 

N 

Percent 

N 

Percent 

N 

Percent 

Odem IIS 

2004 

24 

1 s 

31.2% 

15 

1C) 

19.5% 
v, 4 ’ 

39 

50.6% 
SI 4% 

38 

49.4% 
48 6% 

2006 

31 

43.7% 

II 

15.5% 

J ' 
42 

59.2% 

JJ 

29 

40.8% 

2007 

22 

30.6% 

12 

16.7% 

34 

47.2% 

38 

52.8% 

2008 

29 

39.7% 

II 

15.1% 

40 

54.8% 

33 

45.2% 

2009 

21 

34.4% 

13 

21.3% 

34 

55.7% 

27 

44.3% 

2010 

26 

33.3% 

17 

21.8% 

43 

55.1% 

35 

44.9% 

STAR 2004 

360 

■ - ■ - — 

31.4% 

.I i - - 1 

193 

■ 

16.9% 

553 

— i. 

48.2% 

- - 

595 

51.8% 

STAR 2005 

290 

29.5% 

170 

17.3% 

460 

46.7% 

524 

53.3% 

STAR 2006 

290 

29.4% 

176 

17.8% 

466 

47.2% 

521 

52.8% 

STAR 2007 

283 

29.9% 

196 

20.7% 

479 

50.5% 

469 

49.5% 

STAR 2008 

262 

27.0% 

204 

■ - 

21.0% 

466 

48.0% 

505 

52.0% 

STAR 2009 

297 

31.7% 

221 

23.6% 

518 

55.2% 

420 

44.8% 

STAR 2010 

276 

28.0% 

207 

21.0% 

483 

49.0% 

503 

51.0% 

Change 04-10* 

■ 

mm 

-3.4 

— ■ - ■ 

*4.1 

-- 

+0.8 

-- 

41.8 


Sources: Texas Higher Education Coordinating Board Postsecondary Enrollment by High School reports from 


2003-04 to 2009-10. 

Noies. Graduates enrolled in higher edueation tor the fall of the year (c.g.. 2010 is fall 20101. Statistics include only 
students entering Texas public and private institutions. 

‘Change in percentage points. 



-Four Year University 


Comnunily C'ollgc or Technical School 


Mil’ her Ixiucatxm m Texas 


Figure 1.8. Percentage of STAR high school graduates entering a 4-year university in Texas, a 
community college or technical school in Texas, and entering higher education in Texas. 2004 
through 2010. 

Sources: Texas Higher Education Coordinating Board Postsecondary Enrollment by High School repoits from 
2005-06 to 2009-10. 
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